-- Logs begin at Thu 2022-09-22 14:15:12 UTC, end at Thu 2022-09-22 15:22:04 UTC. -- Sep 22 14:49:26.687427 dv-cinder-844563-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 14:49:26.696972 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 14:49:26 2022] *** Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: nodename: dv-cinder-844563-6-iscsi Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: machine: x86_64 Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: clock source: unix Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: pcre jit disabled Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: detected number of CPU cores: 4 Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: current working directory: / Sep 22 14:49:26.698962 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: detected binary path: /usr/bin/uwsgi-core Sep 22 14:49:26.699695 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: your processes number limit is 47680 Sep 22 14:49:26.699695 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: your memory page size is 4096 bytes Sep 22 14:49:26.699695 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: detected max file descriptor number: 2048 Sep 22 14:49:26.699695 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: lock engine: pthread robust mutexes Sep 22 14:49:26.699695 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: thunder lock: enabled Sep 22 14:49:26.699695 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 14:49:26.699695 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 14:49:26.737869 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: Python main interpreter initialized at 0x558cd2f379c0 Sep 22 14:49:26.737869 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: python threads support enabled Sep 22 14:49:26.737869 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: your server socket listen backlog is limited to 100 connections Sep 22 14:49:26.737869 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: your mercy for graceful operations on workers is 90 seconds Sep 22 14:49:26.738211 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 14:49:26.738292 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: *** Operational MODE: preforking *** Sep 22 14:49:26.738532 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: *** uWSGI is running in multiple interpreter mode *** Sep 22 14:49:26.738532 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: spawned uWSGI master process (pid: 105462) Sep 22 14:49:26.738720 dv-cinder-844563-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 14:49:26.743520 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: spawned uWSGI worker 1 (pid: 105463, cores: 1) Sep 22 14:49:26.743520 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: spawned uWSGI worker 2 (pid: 105464, cores: 1) Sep 22 14:49:26.743520 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 14:49:27.405727 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 14:49:27.411198 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 14:49:28.496189 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:49:28.496189 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: from cryptography.utils import int_from_bytes Sep 22 14:49:28.496888 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:49:28.496888 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: from cryptography.utils import int_from_bytes Sep 22 14:49:28.501653 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:49:28.501653 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: from cryptography.utils import int_from_bytes Sep 22 14:49:28.502079 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:49:28.502079 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: from cryptography.utils import int_from_bytes Sep 22 14:49:31.000464 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 14:49:31.001063 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 14:49:31.001240 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 14:49:31.001444 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 14:49:31.001808 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 14:49:31.001902 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 14:49:31.001980 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 14:49:31.002199 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.002284 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 14:49:31.002518 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.002625 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 14:49:31.002858 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.002960 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 14:49:31.003175 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.003288 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.003627 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.003789 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.003882 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.003966 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.004108 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.004193 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.004528 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.004627 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.004875 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.004977 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.005202 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.005304 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.005519 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.005667 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.005932 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-6-iscsi {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.006023 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.006361 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.006579 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.006673 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.006773 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.007051 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.007144 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-6-iscsi {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.007367 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.007453 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.007673 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.007776 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.007990 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.008080 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.008293 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.008385 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.008637 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.008793 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.008969 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.009243 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.009369 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.009548 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.009782 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.009903 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.010104 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.010282 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.010464 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.010602 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.010786 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.010871 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.011075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.011162 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.011392 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.011533 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.011705 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.011789 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.012008 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.012101 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.012328 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.012410 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-6-iscsi {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.012658 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.012742 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.012973 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.013106 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.013299 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.013400 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-6-iscsi {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.013697 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.013800 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.014000 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.014092 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.014307 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.014400 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.014623 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.014710 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.014966 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.015056 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.015272 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.015367 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.015594 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.015691 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.015905 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.015999 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.016219 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.016317 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.016534 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.016629 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.016831 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.016916 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.017136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.017222 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.017444 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.017541 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.017757 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.017848 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.018059 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.018144 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.018358 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.018444 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.018608 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.018773 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.018940 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.019037 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.019256 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.019342 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.019573 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.019656 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.019881 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.019975 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.020126 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.020211 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.020373 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.020522 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.020687 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.020849 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021002 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021093 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021305 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021390 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021608 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021703 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021911 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.021995 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.022211 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.022297 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.023066 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.023160 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.023374 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.023472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.023682 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.023807 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.023989 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.024097 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.024298 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.024404 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.024606 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.024701 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.024915 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.025018 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.025218 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.025324 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.025535 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.025638 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.025858 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.025940 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.026158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.026247 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.026462 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.026555 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.026818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.026921 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.027131 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.027214 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.027431 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.027527 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.027744 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.027829 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.028059 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.028152 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.028361 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.028459 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.028664 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.028749 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.028969 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.029055 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.029284 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.029377 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.029595 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.029679 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.029901 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.029982 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.030148 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.030240 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.030443 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.030527 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.030783 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.030874 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.031080 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.031167 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.031379 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.031464 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.031680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.031763 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.031981 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.032066 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.032276 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.032359 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.032576 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.032666 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.032877 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.032962 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.033178 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.033260 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.033474 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.033565 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.033777 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.033886 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.034111 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.034211 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.034377 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.034482 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.034675 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.034915 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.035006 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.035083 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.035292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.035398 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.035604 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.035735 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.035914 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.036004 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.036216 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.036383 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.036516 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.036602 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.036815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.036909 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.037116 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.037209 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.037429 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.037521 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.037729 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.037815 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.038180 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.038794 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.038951 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.039037 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.039262 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.039346 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.039563 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.039657 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.039875 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.039960 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.040178 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.040262 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.040479 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.040573 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.040793 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.040886 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.041088 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.041171 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.041390 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.041475 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.041700 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.041783 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.042002 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.042095 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.042300 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.042385 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.042599 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.042683 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.042925 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.043013 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.043225 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.043312 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.043523 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.043616 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.043831 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.043971 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.044115 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.044211 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.044408 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.044493 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.044715 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.044815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.045017 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.045101 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.045319 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.045401 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.045618 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.045749 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.045918 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.046014 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.046228 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.046319 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.046544 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.046646 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.046879 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.046978 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.047204 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:49:31.047289 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.047515 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.047607 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.047839 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.047925 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.048163 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.048253 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.048475 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.048560 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.048783 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.048867 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.049093 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.049178 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.049420 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.049513 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.049728 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.049821 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.050034 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.050131 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.050341 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.050427 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.050655 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.050773 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.050994 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.051099 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.051319 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.051413 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.051630 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.051721 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.051942 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.052026 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.052254 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.052348 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.052562 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.052650 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.052875 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.052960 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.053198 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.053282 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.053515 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.053599 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.053859 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.053955 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.054189 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.054275 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.054518 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.054609 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.054866 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.054980 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.055177 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.055264 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.055469 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.055563 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.055830 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.055937 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.056081 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.056166 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.056388 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.056472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.056729 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.056822 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.057039 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.057125 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.057348 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.057432 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.057662 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.057758 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.057971 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.058058 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.058289 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.058374 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.058597 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.058685 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.058931 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.059017 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.059242 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.059346 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.059548 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.059634 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.059927 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.060027 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.060175 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.060259 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.060485 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.060569 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.060799 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.060890 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.061107 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.061201 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.061418 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.061504 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.061730 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.061815 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.062038 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.062131 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.062346 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.062432 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.062656 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.062769 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.063057 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.063159 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.063360 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.063453 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.063663 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.063748 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.063970 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.064065 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.064271 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.064359 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.064581 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.064664 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.064897 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.064999 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.065201 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.065295 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.065525 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.065608 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.065825 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.065923 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.066137 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.066233 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.066443 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.066529 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.066782 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.066887 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.067075 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.067160 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.067383 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.067468 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.067690 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.067776 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.067991 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.068076 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.068308 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.068392 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.068616 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.068706 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.068919 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.069004 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.069243 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.069349 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.069587 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.069669 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.069901 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.069997 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.070210 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.070307 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.070520 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.070605 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.070853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.070952 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.071165 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.071268 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.071475 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.071568 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.071789 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.071872 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.072095 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.072192 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.072403 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.072488 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.072730 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.072815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.073052 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.073137 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.073351 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.073434 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.073676 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.073772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.074241 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.074327 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.074411 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.074513 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.074581 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.074645 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.074917 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.075007 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.075207 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.075302 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.075511 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.075605 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.075810 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.075904 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.076121 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.076258 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.076421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.076532 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.076720 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.076817 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.077019 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.077124 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.077317 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.077422 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.077615 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.077710 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.077930 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.078036 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.078235 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.078339 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.078533 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.078628 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.078857 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.078953 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.079160 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.079268 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.079500 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.079600 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.079802 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.079896 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.080108 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.080203 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.080454 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.080548 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.080764 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.080860 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.081083 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.081179 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.081391 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.081487 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.081705 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.081801 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.082015 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.082112 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.082324 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.082427 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.082631 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.082757 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.082966 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.083062 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.083284 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.083380 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.083593 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.083697 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.083907 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.084010 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.084212 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.084320 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.084531 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.084642 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.084837 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.085455 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.085682 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.085776 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.086003 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.086128 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.086316 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.086414 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.086639 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.086757 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.086973 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.087147 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.087297 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.087383 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.087614 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.087698 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.087925 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.088025 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.088238 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.088331 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.088545 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.088639 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.088848 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.088951 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.089156 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.089244 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.089465 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.089566 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.089781 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.089885 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.090091 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.090185 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.090403 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.090490 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.090709 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.090819 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.091050 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.091134 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.091353 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.091437 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.091668 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.091764 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.091969 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.092062 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.092279 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.092378 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.092602 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.092689 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.092913 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.093007 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.093224 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.093318 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.093533 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.093619 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.093850 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.093936 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.094159 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.094258 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.094935 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095095 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095095 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095252 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095374 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095468 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095677 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.095983 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.096069 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.096291 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.096416 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.096598 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.096683 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.096905 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.097003 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.097206 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.097306 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.097517 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.097603 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.097822 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.097939 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.098122 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.098259 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.098423 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.098587 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.098779 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.098931 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.099068 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.099243 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.099375 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.099556 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.099721 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.099873 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.100015 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.100199 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.100317 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.100515 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.101312 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.101413 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.101536 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.101705 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.101846 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.102018 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.102149 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.102330 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.102454 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.102656 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.102784 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.102997 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.103129 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.103310 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.103440 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.103624 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.103744 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.103935 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.104060 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.104285 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.104372 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.104604 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.104697 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.104917 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.105000 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.105243 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.105339 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.105563 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.105653 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.105877 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.105971 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.106187 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.106273 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.106497 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.106592 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.106833 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.106942 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.107195 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.107291 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.107456 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.107550 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.107764 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.107863 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.108079 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.108171 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.108385 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.108471 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.108695 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.108788 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.109005 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.109091 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.109307 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.109393 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.109613 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.109701 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.109933 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.110027 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.110251 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.110501 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.110603 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.110855 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.110955 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.111174 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.111260 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.111490 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.111760 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.111847 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.112102 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.112197 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.112426 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.112512 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.112751 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.112846 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.113058 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.113143 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.113363 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.113460 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.113671 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.113759 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.113973 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.114061 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.114276 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.114370 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.114585 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.114671 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.114910 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.114999 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.115214 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.115349 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.115517 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.115617 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.115823 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.115911 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.116123 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.116322 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.116473 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.116574 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.116776 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.116866 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.117079 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.117165 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.117392 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.117492 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.117695 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.117788 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.118002 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.118095 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.118300 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.118394 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.118618 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.118705 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.118949 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.119037 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.119250 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.119338 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.119551 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.119637 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.119851 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.119937 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.120180 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.120266 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.120482 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.120566 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.120790 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.120874 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.121100 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.121187 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.121441 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.121525 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.121740 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.121842 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.122041 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.122127 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.122359 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.122444 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.122659 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.122782 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.122987 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.123074 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.123286 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.123371 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.123590 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.123689 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.123894 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.123987 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.124192 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.124278 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.124499 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.124592 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.124802 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.124887 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.125106 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.125192 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.125411 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.125499 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.125710 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.125795 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.126015 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.126101 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.126314 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.126415 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.126625 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.126744 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.126964 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.127059 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.127265 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.127366 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.127563 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.127657 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.127868 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.127955 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.128171 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.128258 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.128469 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.128556 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.128773 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.128868 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.129071 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.129158 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.129383 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.129485 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.129680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.129775 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.129983 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.130068 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.130281 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.130368 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.130586 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.130680 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.130916 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.131005 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.131217 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.131302 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.131528 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.131624 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.131866 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.131955 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.132168 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.132255 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.132464 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.132551 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.132769 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.132855 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.133068 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.133154 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.133366 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.133460 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.133674 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.133763 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.133985 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.134076 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.134295 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.134390 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.134593 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.134687 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.134932 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.135030 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.135233 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.135326 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.135533 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.135620 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.135832 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.135926 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.136138 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.136232 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.136437 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.136522 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.136736 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.136830 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.137038 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.137134 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.137334 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.137419 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.137630 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.137725 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.137938 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.138022 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.138240 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.138324 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.138540 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.138633 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.138865 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.138957 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.139167 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.139254 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.139493 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.139579 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.139795 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.139879 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.140103 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.140187 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.140415 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.140511 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.140738 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.140824 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.141052 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.141138 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.141359 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.141445 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.141666 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.141751 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.141976 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.142062 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.142277 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.142364 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.142588 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.142681 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.142933 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.143033 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.143245 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.143332 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.143545 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.143632 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.143843 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.143942 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.144159 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.144244 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.144466 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.144552 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.144773 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.144866 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.145086 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.145172 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.145399 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.145483 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.145716 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.145824 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.146013 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.146099 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.146318 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.146405 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.146624 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.146718 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.146954 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.147091 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.147259 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.147353 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.148102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.148254 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.148395 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.148535 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.148708 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.148867 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.149031 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.149176 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.149319 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.149472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.149615 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.149759 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.149921 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.150066 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.150211 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.150369 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.150525 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.150666 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.150925 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.151091 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.151237 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.151383 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.151528 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.151688 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.151836 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.151983 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152133 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152278 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152424 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152590 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152746 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152836 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152914 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.152990 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.153222 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154250 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154366 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154445 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154512 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154576 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154648 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154723 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154819 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154897 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.154966 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.155030 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.155102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.155176 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.155359 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.155489 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.155605 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156105 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156209 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156292 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156370 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156455 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156595 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156721 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.156903 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.157035 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.157208 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.157454 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.157550 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.157774 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.157880 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.158091 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.158169 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.158386 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.158469 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.158686 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.158800 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.159026 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.159166 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.159336 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.159487 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.159637 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.159735 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.159933 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.160031 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.160276 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.160382 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.160554 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.160640 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.160881 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.160975 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.161192 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.161306 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.161523 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.161677 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.161913 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.162066 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.162223 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.162377 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.162513 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.162651 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.162946 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.163711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.163813 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.163882 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.164060 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.164156 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.164368 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.164454 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.164685 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.164785 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.165013 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.165224 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.165325 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.165544 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.165629 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.165872 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.165973 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.166187 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.166275 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.166501 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.166585 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.166834 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.166924 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.167155 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.167270 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.167472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.167566 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.167784 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.167878 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.168115 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.168201 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.168443 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.168529 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.168764 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.168857 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.169064 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.169149 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.169363 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.169494 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.169669 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.169827 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.169970 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.170145 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.170273 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.170485 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.170701 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.170859 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.170953 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.171137 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.171232 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.171451 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.171549 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.171770 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.171868 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.172066 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.172152 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.172367 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.172465 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.172685 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.172781 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.172985 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.173073 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.173299 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.173394 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.173606 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.173723 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.173920 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.174015 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.174233 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.174332 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.174532 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.174625 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.174870 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.175013 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.175181 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.175290 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.175481 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.175572 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.175779 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.175866 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.176081 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.176179 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.176417 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.176506 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.176719 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.176808 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.177036 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.177163 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.177348 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.177442 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.177661 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.177751 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.177964 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.178053 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.178275 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.178365 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.178601 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.178696 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.178985 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.179092 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.179296 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.179384 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.179610 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.179710 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.179932 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.180020 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.180230 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.180317 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.180533 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.180715 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.180838 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.180927 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.181136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.181231 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.181435 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.181532 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.181733 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.181821 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.182037 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.182148 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.182334 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.182461 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.182632 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.182794 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.182958 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.183115 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.183274 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.183428 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.183574 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.183742 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.183891 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.184054 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.184196 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.184369 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.184494 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.184680 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.184795 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.184990 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.185095 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.185302 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.185418 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.185628 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.185722 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.185941 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.186031 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.186269 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.186367 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.186584 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.186673 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.186920 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.187011 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.187234 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.187322 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.187546 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.187640 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.187858 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.187945 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.188171 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.188265 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.188485 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.188579 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.188796 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.188951 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.189105 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.189205 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.189420 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.189515 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.189731 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.189829 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.190056 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.190190 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.190375 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.190603 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.190703 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.190953 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.191051 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.191264 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.191378 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.191573 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.191669 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.191882 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.191969 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.192193 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.192281 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.192504 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.192591 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.192811 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.193092 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.193178 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.193410 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.193505 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.193716 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.193803 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.194037 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.194124 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.194378 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.194469 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.194697 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.194814 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.195041 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.195126 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.195355 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.195462 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.195665 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.195759 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.195975 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.196070 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.196286 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.196400 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.196613 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.196707 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.196932 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.197026 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.197235 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.197336 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.197547 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.197698 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.197848 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.197996 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.198156 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.198303 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.198465 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.198606 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.198801 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.198936 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.199113 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.199306 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.199422 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.199631 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.199722 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.199948 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.200055 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.200270 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.200367 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.200595 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.200684 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.200916 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.201021 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.201231 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.201337 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.201547 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.201639 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.201856 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.201944 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.202165 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.202251 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.202477 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.202566 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.202839 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.203022 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.203162 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.203333 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.203482 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.203660 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.203812 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.203980 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.204153 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.204297 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.204481 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.204607 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.204806 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.204907 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.205129 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.205225 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.205453 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.205540 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.205797 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.205976 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.206103 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.206295 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.206469 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.206634 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.206722 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.207008 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.207113 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.207312 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.207413 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.207616 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.207759 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.207930 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.208029 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.208234 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.208322 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.208582 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.208762 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.208893 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.209110 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.209199 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.209426 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.209514 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.209748 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.210409 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.210609 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.210698 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.210950 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.211039 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.211261 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.211360 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.211581 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.211667 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.211884 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.211973 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.212187 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.212418 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.212508 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.212770 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.212857 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.213077 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.213163 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.213379 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.213469 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.213687 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.213780 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.213992 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.214088 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.214293 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.214380 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.214599 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.214685 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.214941 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.215043 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.215267 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.215355 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.215566 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.215652 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.215868 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.215967 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.216167 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.216254 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.216489 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.216579 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.216775 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.216871 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.217075 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.217163 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.217375 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.217463 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.217679 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.217808 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.217981 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.218079 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.218279 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.218365 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.218585 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.218682 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.218910 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.218998 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.219218 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.219306 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.219537 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.219884 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.220116 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.220201 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.220413 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.220497 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.220728 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.220814 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.221026 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.221110 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.221331 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.221430 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.221642 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.221727 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.221944 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.222030 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.222252 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.222345 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.222558 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.222656 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.222901 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.223002 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.223242 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.223337 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.223552 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.223638 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.223879 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.224076 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.224190 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.224404 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.224491 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.224718 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.224804 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.225044 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.225143 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.225370 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.225457 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.226251 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.226349 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.226557 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.226746 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.226883 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.226985 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.227207 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.227304 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.227514 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.227783 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.227890 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.228121 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.228216 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.228428 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.228533 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.228734 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.228830 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.229107 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.229213 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.229348 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.229498 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.229656 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.229746 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.229962 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.230060 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.230267 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.230368 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.230572 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.230658 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.230900 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.231002 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.231213 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.231310 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.231518 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.231606 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.231831 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.231920 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.232150 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.232239 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.232466 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.232552 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.232779 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.232865 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.233091 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.233178 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.233403 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.233489 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.233707 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.233794 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.234014 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.234102 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.234318 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.234404 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.234623 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.234718 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.234959 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.235059 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.235284 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.235373 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.235594 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.235690 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.235897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.235994 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.236228 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.236553 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.236641 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.236872 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.236970 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.237187 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.237281 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.237500 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.237595 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.237809 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.237970 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.238129 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.238226 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.238445 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.238542 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.238773 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.238864 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.239095 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.239182 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.239404 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.239727 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.239829 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.240062 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.240158 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.240384 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.240546 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.240703 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.240792 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.241005 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.241092 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.241356 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.241452 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.241658 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.241761 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.241963 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.242051 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.242277 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.242378 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.242586 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.242675 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.242913 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.243002 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.243215 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.243304 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.243522 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.243608 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.243822 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.243908 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.244121 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.244210 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.244422 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.244511 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.244722 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.244811 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.245025 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.245114 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.245323 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.245410 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.245622 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.245710 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.245920 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.246007 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.246222 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.246309 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.246523 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.246628 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.246845 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.246944 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.247152 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.247251 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.247450 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.247545 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.247750 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.247839 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.248049 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.248177 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.248349 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.248453 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.248649 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.248736 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.248976 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.249065 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.249298 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.249392 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.249607 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.249692 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.249914 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.250009 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.250219 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.250313 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.250570 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.250664 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.250853 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.250940 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.251161 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.251249 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.251474 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.251560 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.251781 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.251868 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.252090 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.252188 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.252417 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.252504 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.252723 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.252818 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.253032 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.253122 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.253339 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.253427 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.253647 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.253751 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.253953 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.254049 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.254257 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.254345 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.254577 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.254673 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.254929 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.255020 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.255232 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.255322 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.255553 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.255654 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.255865 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.255953 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.256179 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.256266 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.256493 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.256581 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.256840 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.256967 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.257149 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.257236 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.257455 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.257543 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.257763 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.257852 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.258069 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.258158 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.258376 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.258473 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.258682 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.258812 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.259019 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.259122 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.259325 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.259414 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.259632 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.259719 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.259945 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.260041 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.260257 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.260345 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.260579 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.260667 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.260891 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.260986 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.261195 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.261282 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.261511 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.261599 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.261828 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.261925 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.262148 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.262237 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.262463 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.262580 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.262793 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.262900 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.263118 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.263214 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.263433 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.263519 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.263742 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.263838 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.264044 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.264130 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.264284 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 14:49:31.264370 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.264693 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.265028 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.265379 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.265698 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.266050 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.266382 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.266706 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.267045 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.267356 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:49:31.267605 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 14:49:31.419227 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO dbcounter [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Registered counter for database nova_api Sep 22 14:49:31.421728 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Registered counter for database nova_api Sep 22 14:49:31.440746 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.442523 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.447898 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writer thread running {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:31.449570 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:31.506216 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.context [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ef4f12c-857d-4a11-a78f-7971a18e68a1(cell1) {{(pid=105464) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 14:49:31.508267 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.context [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ef4f12c-857d-4a11-a78f-7971a18e68a1(cell1) {{(pid=105463) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 14:49:31.510600 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:49:31.511118 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:49:31.512303 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:49:31.512681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:49:31.512782 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:49:31.513429 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:49:31.513885 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:49:31.514390 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:49:31.515160 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:49:31.515606 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:49:31.515903 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:49:31.517610 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:49:31.517902 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO dbcounter [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Registered counter for database nova_cell0 Sep 22 14:49:31.519645 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Registered counter for database nova_cell0 Sep 22 14:49:31.521941 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO dbcounter [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Registered counter for database nova_cell1 Sep 22 14:49:31.524247 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Registered counter for database nova_cell1 Sep 22 14:49:31.530257 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.532169 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.533967 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.538274 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.538661 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writer thread running {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:31.539829 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:31.540166 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writer thread running {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:31.679296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:31.685486 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO dbcounter [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Registered counter for database nova_cell0 Sep 22 14:49:31.688021 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Registered counter for database nova_cell0 Sep 22 14:49:31.694903 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_db.sqlalchemy.engines [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.698470 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:49:31.699824 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writer thread running {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:31.703388 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:49:32.038582 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:49:32.045934 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:49:32.048155 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: WARNING keystonemiddleware.auth_token [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:49:32.055886 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: WARNING keystonemiddleware.auth_token [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:49:32.397132 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: WARNING keystonemiddleware.auth_token [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:49:32.402876 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:49:32.403151 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: WARNING keystonemiddleware.auth_token [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:49:32.408469 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cd2f379c0 pid: 105464 (default app) Sep 22 14:49:32.408724 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-cae36c86-4ae2-4f11-be31-a4081c1c9a80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:49:32.410568 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:49:32.411886 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001856 Sep 22 14:49:32.412283 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Thu Sep 22 14:49:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:49:32.414481 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cd2f379c0 pid: 105463 (default app) Sep 22 14:50:55.006284 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:50:55.008014 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Sep 22 14:50:55.008423 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:50:55.022659 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=3 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:55.023693 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell0:SELECT=3 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:55.025437 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell1:SELECT=3 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:55.026989 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:55.903122 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-c3cf328d-4795-4355-b07d-dfd1e075ea4a admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:50:55.935404 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-c3cf328d-4795-4355-b07d-dfd1e075ea4a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919093 Sep 22 14:50:55.936148 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 22 14:50:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:50:58.610838 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:50:58.611851 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-cc1e4398-1808-4379-bcca-813275399b06 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 22 14:50:58.612258 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:50:59.075733 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-3ef42417-c72d-478d-b241-07b8e3aade52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:50:59.124058 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-3ef42417-c72d-478d-b241-07b8e3aade52 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505366 Sep 22 14:50:59.124614 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:50:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:50:59.138662 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_api:SELECT=3 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:59.139639 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_cell0:SELECT=3 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:59.141569 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_cell1:SELECT=3 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:59.142628 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:59.352215 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-d933a802-2932-40fc-8364-bd8b37ce6f63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:50:59.423778 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-d933a802-2932-40fc-8364-bd8b37ce6f63 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289803 Sep 22 14:50:59.423935 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 22 14:50:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:02.056379 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-3ef42417-c72d-478d-b241-07b8e3aade52 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:02.057311 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-3ef42417-c72d-478d-b241-07b8e3aade52 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 22 14:51:02.057715 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:02.771312 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-dc9c8029-103d-42e5-8c5c-36e9cd94ee31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "swap": 0, "name": "ds512M", "disk": 5}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:02.811205 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-dc9c8029-103d-42e5-8c5c-36e9cd94ee31 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.746767 Sep 22 14:51:02.822216 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 14:51:02.825360 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-fc117985-9ca4-44b0-86a0-f5230e93a42c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:02.867340 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-fc117985-9ca4-44b0-86a0-f5230e93a42c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046190 Sep 22 14:51:02.867975 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 22 14:51:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:05.463139 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-dc9c8029-103d-42e5-8c5c-36e9cd94ee31 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:05.463931 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-dc9c8029-103d-42e5-8c5c-36e9cd94ee31 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001871 Sep 22 14:51:05.464689 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:05.925005 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-159a2d30-f7f3-4884-9572-5b17d1653a85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "swap": 0}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:05.947272 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-159a2d30-f7f3-4884-9572-5b17d1653a85 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474725 Sep 22 14:51:05.947837 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:05.960340 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-8720c2ba-2d36-4c67-9459-9f05739e17eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:05.992867 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-8720c2ba-2d36-4c67-9459-9f05739e17eb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036370 Sep 22 14:51:05.993596 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 22 14:51:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:08.681490 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-159a2d30-f7f3-4884-9572-5b17d1653a85 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:08.682508 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-159a2d30-f7f3-4884-9572-5b17d1653a85 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 22 14:51:08.682956 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:09.119932 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-06da6fed-98f7-4f54-9259-56b4254f3bc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:09.139544 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-06da6fed-98f7-4f54-9259-56b4254f3bc4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450430 Sep 22 14:51:09.140361 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:09.152840 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-ebc4e297-83a0-4083-b901-722beead903b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:09.179403 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-ebc4e297-83a0-4083-b901-722beead903b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030186 Sep 22 14:51:09.179968 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 22 14:51:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:11.932327 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-06da6fed-98f7-4f54-9259-56b4254f3bc4 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:11.933651 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-06da6fed-98f7-4f54-9259-56b4254f3bc4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003345 Sep 22 14:51:11.934226 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:12.353953 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-3bee1264-73b1-437a-9e50-2225022e7074 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:12.372773 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-3bee1264-73b1-437a-9e50-2225022e7074 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431842 Sep 22 14:51:12.373331 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:12.387405 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-6a17e005-f9eb-4d8b-ae1a-6396c7b654cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:12.418004 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-6a17e005-f9eb-4d8b-ae1a-6396c7b654cd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035826 Sep 22 14:51:12.418820 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Thu Sep 22 14:51:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:15.054210 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-3bee1264-73b1-437a-9e50-2225022e7074 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:15.055300 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-3bee1264-73b1-437a-9e50-2225022e7074 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Sep 22 14:51:15.055713 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:15.493759 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-2bca704a-eb12-40d7-a0f6-26c4be7cb137 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:15.519734 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-2bca704a-eb12-40d7-a0f6-26c4be7cb137 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.457495 Sep 22 14:51:15.520272 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 22 14:51:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:51:18.170390 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-3bee1264-73b1-437a-9e50-2225022e7074 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:18.171492 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-3bee1264-73b1-437a-9e50-2225022e7074 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 22 14:51:18.171905 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:18.587171 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-2d4f20e0-fa65-4792-8ab8-8435a29a98cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "1", "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:18.609753 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-2d4f20e0-fa65-4792-8ab8-8435a29a98cc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.431068 Sep 22 14:51:18.610487 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:18.622931 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-5ea72917-3caf-4c82-aff1-884296b3a84a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:18.653165 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-5ea72917-3caf-4c82-aff1-884296b3a84a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033908 Sep 22 14:51:18.654986 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 22 14:51:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:21.275149 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-2d4f20e0-fa65-4792-8ab8-8435a29a98cc admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:21.276160 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-2d4f20e0-fa65-4792-8ab8-8435a29a98cc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 22 14:51:21.276562 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:21.669809 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-9adbd695-a1b0-4c47-8536-6d581c881ebf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:21.690295 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-9adbd695-a1b0-4c47-8536-6d581c881ebf admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407521 Sep 22 14:51:21.690949 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:21.703120 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-bf024da9-6590-4896-894e-634feec74e04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:21.728712 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-bf024da9-6590-4896-894e-634feec74e04 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029301 Sep 22 14:51:21.729306 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 22 14:51:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:24.426856 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-9adbd695-a1b0-4c47-8536-6d581c881ebf admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:24.428705 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-9adbd695-a1b0-4c47-8536-6d581c881ebf admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002347 Sep 22 14:51:24.429622 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:24.885088 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b29fa3a3-e5c9-45f2-a5f2-b6a58a9105a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "disk": 40, "name": "m1.medium", "vcpus": 2, "swap": 0}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:24.910403 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-b29fa3a3-e5c9-45f2-a5f2-b6a58a9105a6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.475126 Sep 22 14:51:24.919221 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:24.923802 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-71218dbc-bfbf-436f-aaac-fbf037e35240 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:24.955874 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-71218dbc-bfbf-436f-aaac-fbf037e35240 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035703 Sep 22 14:51:24.956685 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 22 14:51:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:51:27.692216 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b29fa3a3-e5c9-45f2-a5f2-b6a58a9105a6 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:27.693229 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-b29fa3a3-e5c9-45f2-a5f2-b6a58a9105a6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 22 14:51:27.693633 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 14:51:28.129140 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-04d563bf-6cfe-4788-8206-25a826797581 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:28.135921 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:28.152911 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-04d563bf-6cfe-4788-8206-25a826797581 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452999 Sep 22 14:51:28.153634 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:28.166552 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-f5679de9-46c5-4ba2-a283-fec9c6ce7344 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:28.191047 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-f5679de9-46c5-4ba2-a283-fec9c6ce7344 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028673 Sep 22 14:51:28.192061 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 22 14:51:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:30.934807 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-04d563bf-6cfe-4788-8206-25a826797581 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:30.936430 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-04d563bf-6cfe-4788-8206-25a826797581 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Sep 22 14:51:30.936836 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:31.399302 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-f2215c11-4524-4795-a09b-bbddad007587 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:31.409445 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:31.426649 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-f2215c11-4524-4795-a09b-bbddad007587 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.483435 Sep 22 14:51:31.427543 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Thu Sep 22 14:51:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:31.440162 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-562c1b09-85f5-4526-a8b5-1b5dde7b7b6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:31.466592 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-562c1b09-85f5-4526-a8b5-1b5dde7b7b6b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030611 Sep 22 14:51:31.467410 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Thu Sep 22 14:51:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:51:48.784227 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-f2215c11-4524-4795-a09b-bbddad007587 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:48.785153 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-f2215c11-4524-4795-a09b-bbddad007587 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Sep 22 14:51:48.785547 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:48.796389 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:49.190819 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-cd09e547-1a86-41d3-81a2-52e70c07675b admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:49.209648 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-cd09e547-1a86-41d3-81a2-52e70c07675b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.417627 Sep 22 14:51:49.210208 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 22 14:51:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:51:50.531337 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-f2215c11-4524-4795-a09b-bbddad007587 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:50.532331 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-f2215c11-4524-4795-a09b-bbddad007587 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 22 14:51:50.532728 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:51.060206 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-d1a66ac0-96dc-4ae5-82e9-95bd60e6adc8 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:51.065566 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.wsgi [None req-d1a66ac0-96dc-4ae5-82e9-95bd60e6adc8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-d1a66ac0-96dc-4ae5-82e9-95bd60e6adc8 admin admin] Request method failure captured: Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Accept: application/json Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Accept-Encoding: gzip, deflate Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Connection: keep-alive Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Content-Length: 0 Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Host: 10.222.0.26 Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Openstack-Api-Version: compute 2.92 Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Openstack-System-Scope: None Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: User-Agent: python-novaclient Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Auth-Token: gAAAAABjLHaGYZcMNEPW2wdxP8fac96snePS9EHLL2q_wvEdsz9KVJv4X1vn1jmgroZhVANvoEhOl-Wwh8ErOS6095tESRD1fDam1hltxjyKb9Isyeeggpy1ymDhKKvc5KHPoyUT_ddttPkv6TQbo2ZYEcqnOE4jHlMoQjQqrMFvpBUrbVYxUV4 Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Domain-Id: None Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Domain-Name: None Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Identity-Status: Confirmed Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Is-Admin-Project: True Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Domain-Id: default Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Domain-Name: Default Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Name: admin Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Role: member,admin,reader Sep 22 14:51:51.068843 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Roles: member,admin,reader Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant: admin Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant-Name: admin Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User: admin Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Domain-Id: default Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Domain-Name: Default Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Id: 4c56fbc6ee754a96af39128dae8f43a4 Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Name: admin Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: method: > Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: exception: Flavor 42 could not be found. Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: action_args: {'id': '42'} Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:51:51.070472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:51.071466 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.072711 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-d1a66ac0-96dc-4ae5-82e9-95bd60e6adc8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:51:51.073767 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-d1a66ac0-96dc-4ae5-82e9-95bd60e6adc8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.400307 Sep 22 14:51:51.073767 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 22 14:51:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:51.080756 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-bfc7a260-be7e-4f33-aa27-8604e52ab63b admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:51.104231 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-bfc7a260-be7e-4f33-aa27-8604e52ab63b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027577 Sep 22 14:51:51.105375 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 22 14:51:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:51:51.116092 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-6b6bc0d2-e230-4366-ab1c-652de162dbc8 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:51.138150 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-6b6bc0d2-e230-4366-ab1c-652de162dbc8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027223 Sep 22 14:51:51.138740 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 22 14:51:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:51:51.148289 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-ddecfe51-f2b5-4c0b-a8a0-e65c7b638144 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:51.153752 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.wsgi [None req-ddecfe51-f2b5-4c0b-a8a0-e65c7b638144 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-ddecfe51-f2b5-4c0b-a8a0-e65c7b638144 admin admin] Request method failure captured: Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Accept: application/json Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Accept-Encoding: gzip, deflate Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Connection: keep-alive Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Content-Length: 0 Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Host: 10.222.0.26 Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Openstack-Api-Version: compute 2.92 Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Openstack-System-Scope: None Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: User-Agent: python-novaclient Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Auth-Token: gAAAAABjLHaGYZcMNEPW2wdxP8fac96snePS9EHLL2q_wvEdsz9KVJv4X1vn1jmgroZhVANvoEhOl-Wwh8ErOS6095tESRD1fDam1hltxjyKb9Isyeeggpy1ymDhKKvc5KHPoyUT_ddttPkv6TQbo2ZYEcqnOE4jHlMoQjQqrMFvpBUrbVYxUV4 Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Domain-Id: None Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Domain-Name: None Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Identity-Status: Confirmed Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Is-Admin-Project: True Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Domain-Id: default Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Domain-Name: Default Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Name: admin Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Role: member,admin,reader Sep 22 14:51:51.157158 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Roles: member,admin,reader Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant: admin Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant-Name: admin Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User: admin Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Domain-Id: default Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Domain-Name: Default Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Id: 4c56fbc6ee754a96af39128dae8f43a4 Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Name: admin Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: method: > Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: exception: Flavor 42 could not be found. Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: action_args: {'id': '42'} Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:51:51.158421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:51.159897 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:51.161298 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-ddecfe51-f2b5-4c0b-a8a0-e65c7b638144 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:51:51.162507 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-ddecfe51-f2b5-4c0b-a8a0-e65c7b638144 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013870 Sep 22 14:51:51.162507 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 22 14:51:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:52.390570 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-6b6bc0d2-e230-4366-ab1c-652de162dbc8 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:52.391620 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-6b6bc0d2-e230-4366-ab1c-652de162dbc8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 22 14:51:52.392023 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:52.922058 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-f925766c-658f-489d-bd5b-aa00103e2cd1 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:52.927602 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.wsgi [None req-f925766c-658f-489d-bd5b-aa00103e2cd1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-f925766c-658f-489d-bd5b-aa00103e2cd1 admin admin] Request method failure captured: Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Accept: application/json Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Accept-Encoding: gzip, deflate Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Connection: keep-alive Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Content-Length: 0 Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Host: 10.222.0.26 Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Openstack-Api-Version: compute 2.92 Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Openstack-System-Scope: None Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: User-Agent: python-novaclient Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Auth-Token: gAAAAABjLHaIOgWUkQgJqCytqbjqZ9MuoOv0neC48WHJtnIsppXo9LDgJ-NnH2V2jM4xsFWwYbiiDWlyN3LbKNTI6L_Hm0SI0fX3IbVXHwaxOOqJtUAVUN4UIrxul1cNbx8N_6RMcC0_OY4w8_pNmekBZszhEo0Cg5ciFbu9gudS0XnR7AJOP-E Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Domain-Id: None Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Domain-Name: None Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Identity-Status: Confirmed Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Is-Admin-Project: True Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Domain-Id: default Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Domain-Name: Default Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Name: admin Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Role: member,admin,reader Sep 22 14:51:52.929136 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Roles: member,admin,reader Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant: admin Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant-Name: admin Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User: admin Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Domain-Id: default Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Domain-Name: Default Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Id: 4c56fbc6ee754a96af39128dae8f43a4 Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Name: admin Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: method: > Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: exception: Flavor 84 could not be found. Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: action_args: {'id': '84'} Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:51:52.930681 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:52.931680 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:52.933127 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-f925766c-658f-489d-bd5b-aa00103e2cd1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:51:52.934402 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-f925766c-658f-489d-bd5b-aa00103e2cd1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.400767 Sep 22 14:51:52.934402 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 22 14:51:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:52.940912 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-798487d2-b8f6-45a8-a336-311af07452fe admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:52.955657 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-798487d2-b8f6-45a8-a336-311af07452fe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018901 Sep 22 14:51:52.956201 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 22 14:51:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:51:52.965640 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-e3c7a0f7-73e7-41e5-bdcc-fc8bbf6ecf7d admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:52.981248 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-e3c7a0f7-73e7-41e5-bdcc-fc8bbf6ecf7d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019150 Sep 22 14:51:52.981768 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 22 14:51:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:51:52.991643 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-b64098e4-46b0-47dd-9e9f-661b34289def admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:52.996913 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.wsgi [None req-b64098e4-46b0-47dd-9e9f-661b34289def admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-b64098e4-46b0-47dd-9e9f-661b34289def admin admin] Request method failure captured: Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Accept: application/json Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Accept-Encoding: gzip, deflate Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Connection: keep-alive Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Content-Length: 0 Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Host: 10.222.0.26 Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Openstack-Api-Version: compute 2.92 Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Openstack-System-Scope: None Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: User-Agent: python-novaclient Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Auth-Token: gAAAAABjLHaIOgWUkQgJqCytqbjqZ9MuoOv0neC48WHJtnIsppXo9LDgJ-NnH2V2jM4xsFWwYbiiDWlyN3LbKNTI6L_Hm0SI0fX3IbVXHwaxOOqJtUAVUN4UIrxul1cNbx8N_6RMcC0_OY4w8_pNmekBZszhEo0Cg5ciFbu9gudS0XnR7AJOP-E Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Domain-Id: None Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Domain-Name: None Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Identity-Status: Confirmed Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Is-Admin-Project: True Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Domain-Id: default Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Domain-Name: Default Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Name: admin Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Role: member,admin,reader Sep 22 14:51:52.998416 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Roles: member,admin,reader Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant: admin Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant-Name: admin Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User: admin Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Domain-Id: default Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Domain-Name: Default Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Id: 4c56fbc6ee754a96af39128dae8f43a4 Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Name: admin Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: method: > Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: exception: Flavor 84 could not be found. Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: action_args: {'id': '84'} Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:51:53.000075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:53.000991 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:53.002853 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-b64098e4-46b0-47dd-9e9f-661b34289def admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:51:53.004131 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-b64098e4-46b0-47dd-9e9f-661b34289def admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011748 Sep 22 14:51:53.004131 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Sep 22 14:51:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:54.222473 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-e3c7a0f7-73e7-41e5-bdcc-fc8bbf6ecf7d admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:54.223515 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-e3c7a0f7-73e7-41e5-bdcc-fc8bbf6ecf7d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 22 14:51:54.223914 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:54.759162 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-9ddcd518-fa72-4217-8bff-bd94eb5514ff admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:54.766206 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.wsgi [None req-9ddcd518-fa72-4217-8bff-bd94eb5514ff admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-9ddcd518-fa72-4217-8bff-bd94eb5514ff admin admin] Request method failure captured: Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Accept: application/json Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Accept-Encoding: gzip, deflate Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Connection: keep-alive Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Content-Length: 0 Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Host: 10.222.0.26 Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Openstack-Api-Version: compute 2.92 Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Openstack-System-Scope: None Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: User-Agent: python-novaclient Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Auth-Token: gAAAAABjLHaK88QBcsdortXBShAq9iaGENQQduGyN-zV_MKb3Z31MFAVzXWhUb5gOBvYScGpM5ddJHPyDkoqHa-cLqtr6jXbR7O6v7C_b9aHcURMa-qNunJy0gaD8HYMl3zTXUtuxFVYCYBfngLCUaTraTy2xOHl9ICMCVFBfb4CjacAXtmynOU Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Domain-Id: None Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Domain-Name: None Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Identity-Status: Confirmed Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Is-Admin-Project: True Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Domain-Id: default Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Domain-Name: Default Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Project-Name: admin Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Role: member,admin,reader Sep 22 14:51:54.767772 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Roles: member,admin,reader Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant: admin Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-Tenant-Name: admin Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User: admin Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Domain-Id: default Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Domain-Name: Default Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Id: 4c56fbc6ee754a96af39128dae8f43a4 Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: X-User-Name: admin Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: method: > Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: exception: Flavor 451 could not be found. Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: action_args: {'id': '451'} Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:51:54.769296 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:54.770195 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.771412 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-9ddcd518-fa72-4217-8bff-bd94eb5514ff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:51:54.772804 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-9ddcd518-fa72-4217-8bff-bd94eb5514ff admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.406759 Sep 22 14:51:54.772804 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 22 14:51:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:54.779074 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b82586a8-faad-4c36-b43f-762287c217c3 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:54.794339 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-b82586a8-faad-4c36-b43f-762287c217c3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018864 Sep 22 14:51:54.794901 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 22 14:51:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:51:54.804905 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:54.819806 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018506 Sep 22 14:51:54.820340 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Sep 22 14:51:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:51:54.829781 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b0597c53-6b4e-4a40-a35c-6dcee09dd795 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:54.834759 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.wsgi [None req-b0597c53-6b4e-4a40-a35c-6dcee09dd795 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b0597c53-6b4e-4a40-a35c-6dcee09dd795 admin admin] Request method failure captured: Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Accept: application/json Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Accept-Encoding: gzip, deflate Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Connection: keep-alive Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Content-Length: 0 Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Host: 10.222.0.26 Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Openstack-Api-Version: compute 2.92 Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Openstack-System-Scope: None Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: User-Agent: python-novaclient Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Auth-Token: gAAAAABjLHaK88QBcsdortXBShAq9iaGENQQduGyN-zV_MKb3Z31MFAVzXWhUb5gOBvYScGpM5ddJHPyDkoqHa-cLqtr6jXbR7O6v7C_b9aHcURMa-qNunJy0gaD8HYMl3zTXUtuxFVYCYBfngLCUaTraTy2xOHl9ICMCVFBfb4CjacAXtmynOU Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Domain-Id: None Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Domain-Name: None Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Identity-Status: Confirmed Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Is-Admin-Project: True Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Domain-Id: default Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Domain-Name: Default Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Project-Name: admin Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Role: member,admin,reader Sep 22 14:51:54.836292 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Roles: member,admin,reader Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/82e4fd5adbe54235a872491a4adc6897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant: admin Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant-Id: 82e4fd5adbe54235a872491a4adc6897 Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-Tenant-Name: admin Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User: admin Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Domain-Id: default Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Domain-Name: Default Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Id: 4c56fbc6ee754a96af39128dae8f43a4 Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: X-User-Name: admin Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: method: > Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: exception: Flavor 451 could not be found. Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: action_args: {'id': '451'} Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:51:54.837815 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:54.838818 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: ERROR nova.api.openstack.wsgi Sep 22 14:51:54.840102 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b0597c53-6b4e-4a40-a35c-6dcee09dd795 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105464) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:51:54.841374 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-b0597c53-6b4e-4a40-a35c-6dcee09dd795 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011491 Sep 22 14:51:54.841374 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 22 14:51:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:56.082519 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:56.083691 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Sep 22 14:51:56.084142 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:56.623595 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-635e8a6c-edb5-4e44-8c44-a274cd21d32d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:56.643482 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-635e8a6c-edb5-4e44-8c44-a274cd21d32d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.419473 Sep 22 14:51:56.644071 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 22 14:51:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:57.885792 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:57.886848 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 22 14:51:57.887248 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:51:58.555046 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-4a0e8d2b-135d-493c-9f9f-72c78e3e0432 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:51:58.573902 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-4a0e8d2b-135d-493c-9f9f-72c78e3e0432 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.533900 Sep 22 14:51:58.574564 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 22 14:51:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:51:59.810400 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:51:59.811451 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 22 14:51:59.811855 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:52:00.352385 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-df6fc0cd-9f2c-46e7-98b8-8ffaf7a249ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:52:00.371312 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-df6fc0cd-9f2c-46e7-98b8-8ffaf7a249ae admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.418242 Sep 22 14:52:00.371867 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 22 14:51:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:52:01.610956 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:52:01.612003 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 22 14:52:01.612393 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:52:02.139123 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-16054fdb-605e-4af1-bd57-dba3cb3331b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:52:02.157775 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-16054fdb-605e-4af1-bd57-dba3cb3331b2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406940 Sep 22 14:52:02.158921 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Sep 22 14:52:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:52:03.398940 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:52:03.399954 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 22 14:52:03.400351 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:52:03.921520 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b56f3e4f-eba1-4681-9aa6-38259c66ea5b admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:52:03.941617 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-b56f3e4f-eba1-4681-9aa6-38259c66ea5b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404776 Sep 22 14:52:03.942148 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Thu Sep 22 14:52:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:53:01.311970 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:53:01.313455 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-73eceadf-e32b-4e86-ab4e-a186d03b08e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Sep 22 14:53:01.313857 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Thu Sep 22 14:53:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:53:01.325462 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:53:01.710466 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-765ca3ae-aa7f-47d3-8205-b86712056fb2 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:53:01.731285 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-765ca3ae-aa7f-47d3-8205-b86712056fb2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410344 Sep 22 14:53:01.731835 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Thu Sep 22 14:53:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:53:01.753816 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=14 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:53:01.757868 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-f056ca93-8c65-4ca4-ba15-52f9f969e609 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:53:01.765273 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-f056ca93-8c65-4ca4-ba15-52f9f969e609 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012959 Sep 22 14:53:01.766445 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Thu Sep 22 14:53:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:53:01.778260 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b0f4f81c-6a03-4481-9602-9f290dfeb8e5 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:53:01.786345 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-b0f4f81c-6a03-4481-9602-9f290dfeb8e5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011731 Sep 22 14:53:01.787039 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Thu Sep 22 14:53:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:53:01.799251 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:53:01.806451 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011573 Sep 22 14:53:01.807017 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Thu Sep 22 14:53:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:53:01.818265 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-4f07e1ec-2f17-4194-804e-beb9662e0431 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:53:01.825906 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-4f07e1ec-2f17-4194-804e-beb9662e0431 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010911 Sep 22 14:53:01.826573 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Thu Sep 22 14:53:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:56:04.914243 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:04.915359 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 22 14:56:04.915770 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:56:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:56:05.063263 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_api:SELECT=6 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:56:05.228909 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:05.234446 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:05.234962 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:05.235394 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:05.236114 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:05.236560 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:05.236980 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:05.268475 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-c9e74cce-9784-4993-9b85-84ad86d00e8b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.206393 Sep 22 14:56:05.269028 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 22 14:56:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:56:06.357293 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:06.358302 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 22 14:56:06.358706 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:56:06.559859 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:06.563492 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:06.563910 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:06.564341 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:06.565060 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:06.565504 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:06.565926 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:06.585448 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-9f45d4a6-9421-44a0-a4e8-9877ec31f361 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083481 Sep 22 14:56:06.586226 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 22 14:56:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:56:18.100060 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:18.101075 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 22 14:56:18.101472 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:56:18.244600 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_cell0:SELECT=4 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:56:18.245316 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_cell1:SELECT=4 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:56:18.246515 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG dbcounter [-] [105464] Writing DB stats nova_api:SELECT=8 {{(pid=105464) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:56:18.294590 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:18.297956 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:18.298421 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:18.298872 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:18.299581 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:18.300023 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:18.300440 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:18.326078 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-0bbee04f-a9e3-4178-b6af-ad22abe76b1c admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085905 Sep 22 14:56:18.326649 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 22 14:56:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:56:19.415346 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:19.416411 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-77fcf7b7-8596-471b-af43-b630200110e9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Sep 22 14:56:19.416866 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Sep 22 14:56:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:56:19.608770 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG nova.api.openstack.wsgi [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] Calling method '>' {{(pid=105464) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:56:19.612232 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:19.612703 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:19.613182 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:19.613842 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:56:19.614284 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:56:19.614701 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: DEBUG oslo_concurrency.lockutils [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:56:19.637140 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: INFO nova.api.openstack.requestlog [None req-b1255a89-8e6f-402c-9bec-7f01b83f39c7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079912 Sep 22 14:56:19.637693 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: [pid: 105464|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Sep 22 14:56:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:57:17.203635 dv-cinder-844563-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 22 14:57:17.204287 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: Thu Sep 22 14:57:17 2022 - graceful shutdown triggered... Sep 22 14:57:17.204760 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: Gracefully killing worker 1 (pid: 105463)... Sep 22 14:57:17.205293 dv-cinder-844563-6-iscsi devstack@n-api.service[105464]: Gracefully killing worker 2 (pid: 105464)... Sep 22 14:57:17.330886 dv-cinder-844563-6-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=4 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:57:18.204297 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: worker 1 buried after 1 seconds Sep 22 14:57:18.204868 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: worker 2 buried after 1 seconds Sep 22 14:57:18.204868 dv-cinder-844563-6-iscsi devstack@n-api.service[105462]: goodbye to uWSGI. Sep 22 14:57:18.205948 dv-cinder-844563-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 22 14:57:18.206493 dv-cinder-844563-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 22 14:57:18.209291 dv-cinder-844563-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 14:57:18.219262 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 14:57:18 2022] *** Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: nodename: dv-cinder-844563-6-iscsi Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: machine: x86_64 Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: clock source: unix Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: pcre jit disabled Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: detected number of CPU cores: 4 Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: current working directory: / Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: detected binary path: /usr/bin/uwsgi-core Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: your processes number limit is 47680 Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: your memory page size is 4096 bytes Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: detected max file descriptor number: 2048 Sep 22 14:57:18.221245 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: lock engine: pthread robust mutexes Sep 22 14:57:18.222327 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: thunder lock: enabled Sep 22 14:57:18.222327 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 14:57:18.222327 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 14:57:18.261208 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: Python main interpreter initialized at 0x5653673d39c0 Sep 22 14:57:18.261208 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: python threads support enabled Sep 22 14:57:18.261208 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: your server socket listen backlog is limited to 100 connections Sep 22 14:57:18.261208 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: your mercy for graceful operations on workers is 90 seconds Sep 22 14:57:18.261645 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 14:57:18.261645 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: *** Operational MODE: preforking *** Sep 22 14:57:18.261916 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: *** uWSGI is running in multiple interpreter mode *** Sep 22 14:57:18.261916 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: spawned uWSGI master process (pid: 120677) Sep 22 14:57:18.279454 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: spawned uWSGI worker 1 (pid: 120694, cores: 1) Sep 22 14:57:18.279454 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: spawned uWSGI worker 2 (pid: 120695, cores: 1) Sep 22 14:57:18.279454 dv-cinder-844563-6-iscsi devstack@n-api.service[120677]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 14:57:18.262110 dv-cinder-844563-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 14:57:18.951213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 14:57:18.965056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 14:57:20.119679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:57:20.119679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: from cryptography.utils import int_from_bytes Sep 22 14:57:20.120322 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:57:20.120322 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: from cryptography.utils import int_from_bytes Sep 22 14:57:20.125242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:57:20.125242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: from cryptography.utils import int_from_bytes Sep 22 14:57:20.125713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:57:20.125713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: from cryptography.utils import int_from_bytes Sep 22 14:57:22.555263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 14:57:22.555895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 14:57:22.555986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 14:57:22.556285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 14:57:22.556701 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 14:57:22.556793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 14:57:22.556882 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 14:57:22.557640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.557737 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 14:57:22.557968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 14:57:22.558067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.558148 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 14:57:22.558235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.558466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.558567 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.558816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.558935 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.559130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.559237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.559452 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.559552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.559767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.559927 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.560086 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.560235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.560379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.560561 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.560718 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.560872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.561023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.561164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-6-iscsi {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.561316 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.561460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.561608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.561765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.561986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.562149 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-6-iscsi {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.562292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.562462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.562612 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.562930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.563114 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.563288 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.563435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.563590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.563590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.565172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.565441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.565650 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.565856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.566086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.566308 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.566541 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.566767 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.566986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.567194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.567412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.567627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.567833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.568050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.568266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.568490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.568706 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.568930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.569136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.569355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.569570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.569795 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.570018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-6-iscsi {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.570237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.570451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.570639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.571080 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.572770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-6-iscsi {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.572994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.573157 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.573309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.573455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.573636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.573871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.574018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.574018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.574307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.574451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.574624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.574928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.575106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.575263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.575407 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.575551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.575693 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.575843 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.575995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.576154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.577251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.577413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.577567 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.577712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.577893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.578040 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.578190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.578334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.578476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.578625 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.578813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.578969 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.579121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.579264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.579413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.579562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.579736 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.579881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.580022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.580170 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.580313 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.580463 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.580619 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.580769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.580934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.581346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.581507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.581693 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.582419 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.582839 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.583043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.583190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.583346 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.583494 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.583648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.583792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.584089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.584229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.584369 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.584501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.584627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.584743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.584878 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585022 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585206 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585296 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585386 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585475 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585798 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.585986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586450 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586899 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.586983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587067 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587423 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587589 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587671 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587853 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.587937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.588020 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.588103 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.588185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.588846 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.588943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589030 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589212 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589301 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589582 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.589935 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590026 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590026 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590179 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590261 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590622 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590805 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.590901 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.591527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.591631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.591631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.591798 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.591890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592115 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592763 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.592948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593185 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593567 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593658 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.593915 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594616 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.594959 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595133 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595314 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595562 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595747 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.595912 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596090 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596296 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596386 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596470 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596640 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596824 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.596914 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597423 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597589 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597864 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.597954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598037 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598304 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598477 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598643 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598838 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.598930 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599353 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599537 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599685 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.599984 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.600205 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.600315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.600513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.600615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.600818 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.600911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.601137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:57:22.601239 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.601481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.601579 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.601815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.601936 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.602144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.602253 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.602473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.602578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.602828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.602944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.603175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.603346 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.603493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.603636 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.603800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.604602 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.604743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.604886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.605081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.605255 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.605407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.605571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.605722 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.606271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.606439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.606577 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.606717 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.606846 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.606946 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607073 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607427 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607701 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.607975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.608079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.608301 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.608402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.608633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.608726 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.608952 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.609093 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.609267 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.609386 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.609589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.609708 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.609903 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.610038 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.610214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.610341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.610527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.610656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.610893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.611015 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.611208 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.611334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.611517 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.611806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.611806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.612052 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.612186 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.612621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.612834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.612956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613306 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613424 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613660 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613791 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.613903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.614018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.614141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.614252 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.614370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.614545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.614665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.614903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.615034 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.615217 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.615345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.615556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.615677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.615855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.615951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.616167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.616324 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.616479 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.616580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.616787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.616956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.617093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.617199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.617397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.617560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.617703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.617796 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.618011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.618114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.618315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.618415 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.618619 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.618911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.619019 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.619116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.619307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.619428 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.619741 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.619847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.619939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.620013 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.620258 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.620398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.620583 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.620696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.620881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.620996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.621187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.621291 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.621499 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.621604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.621808 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.621919 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.622146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.622261 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.622506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.622879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.622976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623685 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.623993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.624101 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.624298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.624406 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.624607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.624712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.624918 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.625017 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.625225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.625337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.625548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.625666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.625842 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.625971 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.626150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.626259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.626460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.626563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.626789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.626905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.627119 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.627222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.627432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.627525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.627744 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.627846 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.628064 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.628166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.628382 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.628474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.628686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.628779 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.628995 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.629100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.629298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.629391 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.629599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.629706 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.629902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.630002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.630206 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.630299 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.630511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.630611 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.630852 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.630952 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.631138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.631245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.631442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.631557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.631745 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.631838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.632053 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.632155 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.632360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.632491 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.632674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.632776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.632981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.633090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.633266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.633376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.633591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.633691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.633900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.633993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.634225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.634319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.634516 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.634660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.634888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.634984 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.635224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.635320 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.635543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.635680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.635861 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.635954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.636174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.636271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.636485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.636577 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.636798 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.636944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.637105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.637233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.637426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.637569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.637738 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.637844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.638050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.638142 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.638359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.638459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.638679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.638821 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.639013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.639114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.639341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.639458 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.639638 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.639740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.639953 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.640054 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.640266 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.640365 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.640589 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.640690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.640899 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.640993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.641218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.641391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.641524 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.641619 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.641838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.641975 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.642145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.642276 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.642513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.642858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.643177 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.643354 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.643504 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.643657 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.643826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.643972 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.644124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.644278 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.644433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.644585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.644740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.644892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.645042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.645193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.645337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.645479 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.645635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.645842 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.645991 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.646125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.646436 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.646819 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.647116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.647241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.647449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.647627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.647773 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.647928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.648080 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.648231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.648389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.648533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.648666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.648979 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.649097 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.649288 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.649481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.649583 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.649826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.649928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.650170 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.650262 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.650488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.650579 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.651347 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.651659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.651752 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.651967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.652067 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.652281 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.652381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.652590 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.652682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.652893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.653251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.653353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.653494 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.653568 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.653805 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.653949 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.654115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.654248 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.654438 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.654571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.654777 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.654929 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.655089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.655233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.655394 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.655527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.655715 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.655846 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.656019 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.656170 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.656322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.656623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.656768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.656925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.657066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.657270 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.657406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.657583 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.657724 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.657888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.658029 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.658204 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.658339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.658525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.658658 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.658858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.659004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.659175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.659316 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.659488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.659621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.659798 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.659944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.660118 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.660258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.660435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.660580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.660748 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.660893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.661065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.661206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.661379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.661521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.661691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.661832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.662003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.662153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.662318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.662451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.662623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.662785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.662961 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.663087 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.663272 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.663504 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.663647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.663812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.663954 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.664139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.664272 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.664463 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.664763 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.664899 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.665090 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.665221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.665404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.665550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.665723 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.665865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.666073 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.666214 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.666447 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.667298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.667628 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.667761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.667942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.668091 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.668248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.668390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.668559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.668693 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.668866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.669172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.669305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.669482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.669624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.669787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.670036 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.670171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.670369 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.670509 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.670676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.670884 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.671033 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.671303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.671505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.671648 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.671859 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.671993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.672196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.672336 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.672501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.672644 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.672811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.672953 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.673115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.673439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.673674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.673812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.673947 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.674077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.674203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.674330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.674446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.674607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.674748 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.675124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.675443 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.675764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.675957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.676118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.676272 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.676417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.676560 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.676713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.676865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.677010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.677153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.677297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.677440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.677591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.677793 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.677956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.678109 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.678261 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.678412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.678556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.678709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.678906 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.679100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.679261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.679421 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.679579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.679722 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.679875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.680019 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.680168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.680361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.680520 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.680665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.680815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.680987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.681134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.681285 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.681443 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.681576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.681706 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.681872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.682028 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.682220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.682381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.682527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.682669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.682870 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.683025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.683178 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.683321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.683465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.683732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.683893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.684048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.684206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.684357 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.684501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.684642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.684783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.684925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.685151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.685308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.685459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.685609 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.685759 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.685923 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.686076 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.686227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.686371 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.686512 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.686662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.686852 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.686998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.687140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.687281 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.687422 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.687565 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.687721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.687887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.688048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.688202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.688345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.688487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.688641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.688795 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.688939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.689088 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.689231 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.689380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.689532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.689675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.689827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.689971 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.690112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.690263 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.690406 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.690548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.690696 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.690906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.691050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.691203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.691355 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.691498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.691638 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.691790 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.691933 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.692152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.692305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.692457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.692600 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.692749 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.692900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.693062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.693213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.693362 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.693513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.693664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.693916 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.694070 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.694222 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.694374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.694526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.694669 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.694853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.695002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.695154 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.695305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.695455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.695599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.695760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.695911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.696056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.696206 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.696356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.696499 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.696653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.696797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.696939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.697081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.697223 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.697366 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.697516 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.697704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.697849 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.698004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.698167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.698320 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.698472 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.698623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.698826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.698985 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.699129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.699281 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.699425 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.699566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.699718 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.699872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.700016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.700172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.700317 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.700466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.700617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.700767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.700919 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.701072 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.701216 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.701358 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.701500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.701659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.701812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.701955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.702105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.702248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.702391 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.702532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.702683 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.702850 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.702992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.703150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.703295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.703446 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.703608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.703760 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.703921 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.704076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.704076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.704348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.704499 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.704643 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.704785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.704926 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.705075 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.705228 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.705387 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.705539 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.705682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.705832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.705974 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.706126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.706269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.706412 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.706562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.706712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.706913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.707068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.707220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.707373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.707523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.707667 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.707810 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.707977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.708134 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.708278 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.708428 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.708579 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.708737 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.708881 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.709031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.709181 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.709339 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.709489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.709646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.709799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.709942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.710091 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.710234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.710383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.710540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.710685 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.710863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.711007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.711157 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.711330 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.711482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.711633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.711778 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.711922 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.712071 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.712223 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.712366 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.712508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.712656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.712806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.712956 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.713159 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.713976 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.714136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.714303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.714460 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.714611 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.714797 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.714959 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.715104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.715350 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.715499 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.715649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.715806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.716226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.716375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.716560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.716718 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.716922 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.717082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.717249 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.717401 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.717544 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.717694 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.717852 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.717997 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.718163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.718330 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.718475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.718627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.718812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.718970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.719122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.719266 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.719419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.719563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.719718 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.719862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.720004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.720164 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.720315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.720615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.720773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.720944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.721152 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.721309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.721578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.721873 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.722035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.722365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.722522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.722924 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.723100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.723256 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.723401 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.723728 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.723877 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.724030 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.724335 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.724485 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.724649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.724946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.725095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.725252 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.725564 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.725724 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.725868 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.726171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.726319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.726499 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.726800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.726955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.727098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.727315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.727478 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.727712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.727875 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.728019 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.728180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.728331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.728610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.728762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.729562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.729715 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.729891 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.730049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.730202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.730360 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.730521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.730677 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.730911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.731129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.731290 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.731434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.731725 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.731875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.732044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.732198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.732356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.732508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.732652 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.732797 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.733119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.733295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.733440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.733592 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.733735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.733886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.734031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.734188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.734332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.734481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.734624 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.734791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.734951 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.735106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.735259 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.735402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.735543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.735694 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.735846 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.736002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.736153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.736313 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.736465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.736608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.736761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.736905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.737066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.737218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.737362 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.737512 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.737666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.737810 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.737951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.738094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.738244 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.738389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.738540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.738691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.738869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.739031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.739175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.739330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.739482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.739626 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.739768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.739918 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.740069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.740227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.740371 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.740513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.740668 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.740814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.740974 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.741131 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.741276 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.741426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.741593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.741742 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.741894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.742047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.742193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.742343 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.742492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.742634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.742856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.743027 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.743332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.743484 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.743484 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.743754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.743911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.744055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.744198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.744348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.744534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.744692 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.744849 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.745016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.745168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.745320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.745464 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.745607 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.745796 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.745940 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.746090 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.746234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.746378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.746530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.746674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.746845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.747000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.747143 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.747298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.747451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.747595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.747745 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.747888 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.748030 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.748173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.748325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.748549 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.748858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.749092 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.749250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.749418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.749577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.749808 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.749958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.750226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.750381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.750566 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.750717 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.750888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.751029 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.751204 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.751383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.751536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.751682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.751871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.752137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.752288 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.752461 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.752613 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.752765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.752914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.753058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.753200 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.753609 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.753763 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.753913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.754058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.754209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.754353 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.754509 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.754655 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.754852 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.755000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.755143 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.755296 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.755458 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.755602 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.755752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.755897 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.756047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.756199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.756342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.756485 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.756634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.756779 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.756930 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.757082 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.757226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.757378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.757521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.757663 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.757805 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.757962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.758106 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.758333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.758483 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.758670 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.758856 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.759074 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.759401 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.759671 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.759832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.760002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.760195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.760347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.760491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.760664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.760812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.760955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.761173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.761332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.761477 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.761621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.761784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.761928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.762083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.762229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.762372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.762521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.762673 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.762855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.763045 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.763207 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.763358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.763666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.763817 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.763986 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.764139 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.764286 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.764428 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.764571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.764714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.764865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.765017 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.765161 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.765315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.765466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.765625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.765777 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.765929 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.766081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.766224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.766375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.766527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.766677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.766910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.767055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.767198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.767342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.767501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.767656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.767799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.767941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.768083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.768234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.768380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.768530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.768674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.768824 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.768968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.769131 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.769276 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.769426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.769584 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.769727 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.769868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.770020 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.770171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.770314 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.770456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.770600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.770777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.770934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.771094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.771243 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.771409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.771629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.771802 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.771977 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.772287 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.772573 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.772838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.773009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.773173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.773324 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.773479 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.773647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.773891 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.773891 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.774290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.774442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.774591 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.774591 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.774976 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.775138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.775138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.775423 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.776225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.776387 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.776537 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.776844 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.777058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.777224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.777397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.777553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.777710 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.777871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.778029 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.778186 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.778335 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.778606 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.778786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.778955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.779107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.779274 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.779438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.779589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.779750 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.779901 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.780208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.780405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.780564 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.780715 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.780872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.781022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.781170 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.781332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.781489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.781646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.781804 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.781962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.782119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.782269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.782425 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.782574 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.782795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.782962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.783124 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.783272 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.783439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.783598 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.783755 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.783995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.784179 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.784436 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.784600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.784761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.784911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.784911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.785211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.785359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.785586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.785849 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.786006 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.786203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.786359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.786508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.786666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.786845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.786995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.787155 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.787307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.787456 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.787619 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.787780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.787929 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.788077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.788227 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.788384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.788547 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.788705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.788855 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.789004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.789162 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.789321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.789473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.789640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.789790 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.789970 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.790134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.790294 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.790459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.790610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.790782 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.790947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.791134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.791327 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.792001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.792161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.792329 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.792486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.792639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.792874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.793027 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.793184 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.793345 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.793502 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.793662 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.793810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.793985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.794215 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.794379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.794643 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.794861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.795016 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.795167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.795316 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.795465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.795613 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.795613 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.795907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.796063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.796211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.796359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.796533 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.796693 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.796842 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.796999 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.797149 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.797305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.797464 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.797612 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.797762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.797910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.798074 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.798224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.798385 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.798553 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.798703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.798887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.799046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.799233 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.799403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.799553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.799703 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.799852 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.800001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.800161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.800331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.800484 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.800644 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.800793 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.800942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.801105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.801255 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.801411 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.801561 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.801718 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.801876 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.802035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.802185 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.802333 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.802492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.802640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.802810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.802977 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.803129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.803286 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.803435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.803591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.803750 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.803900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.804049 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.804216 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.804439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.804627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.804878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.805041 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.805193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.805395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.805555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.805706 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.805865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.805865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.806159 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.806315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.806472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.806641 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.806881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.807065 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.807227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.807385 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.807541 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.807700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.807856 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.808014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.808163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.808313 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.808468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.808631 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.808790 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.808939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.809095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.809244 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.809395 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.809558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.809708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.809864 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.810013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.810169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.810333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.810491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.810651 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.810825 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.810977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.811126 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.811291 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.811451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.811601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.811750 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.811899 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.812049 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.812207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.812358 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.812525 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.812681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.812831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.812992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.813143 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.813303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.813453 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.813603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.813766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.813929 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.814086 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.814243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.814392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.814651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.814830 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.815101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.815259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.815417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.815576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.815733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.815903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.816060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.816060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.816351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.816499 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.816659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.816822 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.816980 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.817138 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.817295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.817453 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.817616 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 14:57:22.817781 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.817931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.818187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.818505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.819518 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.819853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.820169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.820485 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.820799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.821112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.821424 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.821733 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.822048 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.822355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.822701 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.823052 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.823363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.823675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.824018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.824356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.824703 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.825004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.825320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.825649 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.826635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.826999 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.827332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.827658 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.827976 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.828319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.828641 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.828958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.829278 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.829597 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.829914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.830229 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.830566 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.830922 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.831239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.831572 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.831893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.832218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.832537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.832858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.833195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.833512 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.833828 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.834142 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.834457 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.834828 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.835142 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.835462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.835855 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.836751 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.837086 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.837425 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.837760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.838078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.838958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.839295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.839653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.839972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.840323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.840657 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.841236 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.841559 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.841870 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:57:22.842117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 14:57:22.879829 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO dbcounter [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Registered counter for database nova_api Sep 22 14:57:22.900289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_db.sqlalchemy.engines [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:22.907875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writer thread running {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:22.913134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Registered counter for database nova_api Sep 22 14:57:22.936006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:22.943070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:22.966518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.context [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ef4f12c-857d-4a11-a78f-7971a18e68a1(cell1) {{(pid=120694) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 14:57:22.970587 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:57:22.971086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:57:22.972646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:57:22.973378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:57:22.973820 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:57:22.975840 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:57:22.977832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO dbcounter [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Registered counter for database nova_cell0 Sep 22 14:57:22.981913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO dbcounter [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Registered counter for database nova_cell1 Sep 22 14:57:22.989645 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_db.sqlalchemy.engines [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:22.991362 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_db.sqlalchemy.engines [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:22.996513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writer thread running {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:23.002319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.context [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ef4f12c-857d-4a11-a78f-7971a18e68a1(cell1) {{(pid=120695) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 14:57:23.006432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:57:23.006951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:57:23.008526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:57:23.009298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:57:23.009748 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:57:23.012291 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:57:23.014289 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Registered counter for database nova_cell0 Sep 22 14:57:23.018321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Registered counter for database nova_cell1 Sep 22 14:57:23.025489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:23.028044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:23.033872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:23.036564 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:23.138677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writer thread running {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:23.148715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO dbcounter [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Registered counter for database nova_cell0 Sep 22 14:57:23.155990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_db.sqlalchemy.engines [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:23.160381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writer thread running {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:23.185638 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO dbcounter [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Registered counter for database nova_cell0 Sep 22 14:57:23.192413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_db.sqlalchemy.engines [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:57:23.197085 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writer thread running {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:57:23.482571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: WARNING keystonemiddleware.auth_token [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:57:23.489912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: WARNING keystonemiddleware.auth_token [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:57:23.521531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:57:23.528896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:57:23.837482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: WARNING keystonemiddleware.auth_token [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:57:23.843818 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: WARNING keystonemiddleware.auth_token [None req-296f1a82-69c9-4bb8-a253-5e83a6c5feb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:57:23.849119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653673d39c0 pid: 120694 (default app) Sep 22 14:57:23.873831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 14:57:23.879894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: WARNING keystonemiddleware.auth_token [None req-3128729b-e483-4d2b-ba5a-83ca67fa2f00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 14:57:23.885244 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653673d39c0 pid: 120695 (default app) Sep 22 14:58:01.087910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:01.089097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:01.090065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:01.091504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:02.750293 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fe3137be-864e-4af1-8d3e-f8a829b16c12 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Action: 'create', calling method: .version_select at 0x7f77e72824c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1838321263"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:04.652852 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fe3137be-864e-4af1-8d3e-f8a829b16c12 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.578842 Sep 22 14:58:04.655464 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Sep 22 14:58:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3584 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 22 14:58:04.672423 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:04.673497 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:04.674251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:04.687273 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:04.994922 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b40c95f7-c1e9-4bea-8708-c90070fe1b84 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e72d9040>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:05.388519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b40c95f7-c1e9-4bea-8708-c90070fe1b84 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a" status: 200 len: 345 microversion: 2.1 time: 0.721424 Sep 22 14:58:05.389255 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:04 2022] GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a => generated 345 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:06.404280 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ddb87edb-8fe7-4158-9d5e-f1032ba4e67a tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e71523a0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:06.562183 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ddb87edb-8fe7-4158-9d5e-f1032ba4e67a tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a" status: 200 len: 346 microversion: 2.1 time: 0.162375 Sep 22 14:58:06.563323 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:06 2022] GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a => generated 346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:06.579001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a86940a7-fcd1-4fa1-a388-d5498753db3b tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Action: 'create', calling method: .version_select at 0x7f77e7144280>, body: {"snapshot": {"volume_id": "51472512-faea-4a80-a111-082076bcb19a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1018232962"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:07.129607 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a86940a7-fcd1-4fa1-a388-d5498753db3b tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.554909 Sep 22 14:58:07.137204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 2/4] 10.222.0.26 () {60 vars in 1162 bytes} [Thu Sep 22 14:58:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:07.142522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-433189ff-3964-483c-9737-f71a7526bd9d tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7152a60>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:07.342975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-433189ff-3964-483c-9737-f71a7526bd9d tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 287 microversion: 2.1 time: 0.203568 Sep 22 14:58:07.344007 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:07 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:07.355351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9d5c0816-61f9-4144-aa7b-4941bf317ee5 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7164160>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:07.433757 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9d5c0816-61f9-4144-aa7b-4941bf317ee5 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.082257 Sep 22 14:58:07.434406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Sep 22 14:58:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:07.446534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e4eff425-7c37-4e6a-9fe9-f3fd21a2829f tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e70ec1f0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:07.504329 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e4eff425-7c37-4e6a-9fe9-f3fd21a2829f tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 287 microversion: 2.1 time: 0.062073 Sep 22 14:58:07.505074 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:07 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:08.519699 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bc5e408e-4121-4d9a-8626-27b35160a2c4 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e70e8550>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:08.592537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bc5e408e-4121-4d9a-8626-27b35160a2c4 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 287 microversion: 2.1 time: 0.078859 Sep 22 14:58:08.597852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:08 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:09.607430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7404767a-44cd-46d7-bc71-a59e8bba3af5 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7152b80>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:09.667984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7404767a-44cd-46d7-bc71-a59e8bba3af5 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 287 microversion: 2.1 time: 0.066365 Sep 22 14:58:09.668823 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:09 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:10.682548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23046497-174c-4ae4-90ad-5f03ebffb606 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7164790>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:10.745314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-23046497-174c-4ae4-90ad-5f03ebffb606 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 288 microversion: 2.1 time: 0.067726 Sep 22 14:58:10.752842 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:10 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:10.757466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2d7ef34e-bc62-49d8-a9ce-68bf7ec74768 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e71524c0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:10.903994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2d7ef34e-bc62-49d8-a9ce-68bf7ec74768 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 202 len: 0 microversion: 2.1 time: 0.150236 Sep 22 14:58:10.904554 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Sep 22 14:58:10 2022] DELETE /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 14:58:10.913770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-58159f09-7fee-42e3-bcd2-4d2c99e09a28 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7164040>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:10.968412 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-58159f09-7fee-42e3-bcd2-4d2c99e09a28 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 287 microversion: 2.1 time: 0.059032 Sep 22 14:58:10.974673 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:10 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:11.985085 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-abaac68b-2920-40f9-971b-e99a02035072 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e70ec430>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:12.039865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-abaac68b-2920-40f9-971b-e99a02035072 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 287 microversion: 2.1 time: 0.061275 Sep 22 14:58:12.045930 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:11 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:13.052455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ecd6bee8-c28f-4a60-8bdc-68514ac9828a tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e71440d0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:13.100197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ecd6bee8-c28f-4a60-8bdc-68514ac9828a tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 200 len: 287 microversion: 2.1 time: 0.051317 Sep 22 14:58:13.106674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:13 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:14.125971 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a63109e1-f03f-401f-b486-31953e061f4b tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e71523a0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:14.202819 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-a63109e1-f03f-401f-b486-31953e061f4b tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] HTTP exception thrown: Snapshot 6c2ece8c-7291-4a36-8fa7-c626d954bfe6 could not be found. Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a63109e1-f03f-401f-b486-31953e061f4b tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Request method failure captured: Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 HTTP/1.1 Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHf4fPgllpCWclZaxwyLQfVCMzUuvUwjbgWEdVvVikF7ykGkCDcakIHh9nLNs5Z-8EQw5SjLyddgGTLKczes82JvdYUieVE1fifNhtuI8E2PdTFil7w6A68_1iKMdllV-Rq-61x2-4_EyiwzmVA5cAFaqHzEd1sRUz2VVH1zLAzf0sw Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 14:58:14.208277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88d7db84f4364c589668c55826cce241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88d7db84f4364c589668c55826cce241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 2c38e2a135634a0fb0fb735c61cabf59 Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Snapshot 6c2ece8c-7291-4a36-8fa7-c626d954bfe6 could not be found. Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '6c2ece8c-7291-4a36-8fa7-c626d954bfe6'} Sep 22 14:58:14.209424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6c2ece8c-7291-4a36-8fa7-c626d954bfe6 could not be found. (HTTP 404) (Request-ID: req-b296bf24-f76b-4e37-b302-df448cba2b46) Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:14.210048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 14:58:14.211508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6c2ece8c-7291-4a36-8fa7-c626d954bfe6 could not be found. Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 22 14:58:14.213704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6c2ece8c-7291-4a36-8fa7-c626d954bfe6 could not be found. Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6c2ece8c-7291-4a36-8fa7-c626d954bfe6 could not be found. Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a63109e1-f03f-401f-b486-31953e061f4b tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Returning 404 to user: Snapshot 6c2ece8c-7291-4a36-8fa7-c626d954bfe6 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:58:14.216172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a63109e1-f03f-401f-b486-31953e061f4b tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6" status: 404 len: 111 microversion: 2.1 time: 0.100331 Sep 22 14:58:14.223018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cba51d92-9e4d-4392-82e8-869b30f97c9a tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7335160>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:14.234434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1251 bytes} [Thu Sep 22 14:58:14 2022] GET /compute/v2.1/os-snapshots/6c2ece8c-7291-4a36-8fa7-c626d954bfe6 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:58:14.382593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cba51d92-9e4d-4392-82e8-869b30f97c9a tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a" status: 202 len: 0 microversion: 2.1 time: 0.164189 Sep 22 14:58:14.384243 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 14:58:14 2022] DELETE /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 14:58:14.393712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9b369fa5-14ff-4a23-912a-29f990fe5e66 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7aae9d0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:14.530330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9b369fa5-14ff-4a23-912a-29f990fe5e66 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a" status: 200 len: 345 microversion: 2.1 time: 0.141067 Sep 22 14:58:14.531221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:14 2022] GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:15.552956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bbba5b45-954e-4df9-8863-c2f45771c51c tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7164430>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:15.599591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-bbba5b45-954e-4df9-8863-c2f45771c51c tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] HTTP exception thrown: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bbba5b45-954e-4df9-8863-c2f45771c51c tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Request method failure captured: Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a HTTP/1.1 Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHf4fPgllpCWclZaxwyLQfVCMzUuvUwjbgWEdVvVikF7ykGkCDcakIHh9nLNs5Z-8EQw5SjLyddgGTLKczes82JvdYUieVE1fifNhtuI8E2PdTFil7w6A68_1iKMdllV-Rq-61x2-4_EyiwzmVA5cAFaqHzEd1sRUz2VVH1zLAzf0sw Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 14:58:15.640647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88d7db84f4364c589668c55826cce241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88d7db84f4364c589668c55826cce241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 2c38e2a135634a0fb0fb735c61cabf59 Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '51472512-faea-4a80-a111-082076bcb19a'} Sep 22 14:58:15.641713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. (HTTP 404) (Request-ID: req-e26a1165-39e1-421a-82ea-82384ef4450c) Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.642347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 14:58:15.643340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 14:58:15.644211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bbba5b45-954e-4df9-8863-c2f45771c51c tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Returning 404 to user: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:58:15.645081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bbba5b45-954e-4df9-8863-c2f45771c51c tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a" status: 404 len: 109 microversion: 2.1 time: 0.100249 Sep 22 14:58:15.650341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:15 2022] GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:58:15.661165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cff27f1b-346f-46ae-918a-1ee53a323e95 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7152550>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:15.726771 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-cff27f1b-346f-46ae-918a-1ee53a323e95 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] HTTP exception thrown: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cff27f1b-346f-46ae-918a-1ee53a323e95 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Request method failure captured: Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a HTTP/1.1 Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHf4fPgllpCWclZaxwyLQfVCMzUuvUwjbgWEdVvVikF7ykGkCDcakIHh9nLNs5Z-8EQw5SjLyddgGTLKczes82JvdYUieVE1fifNhtuI8E2PdTFil7w6A68_1iKMdllV-Rq-61x2-4_EyiwzmVA5cAFaqHzEd1sRUz2VVH1zLAzf0sw Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 14:58:15.731566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88d7db84f4364c589668c55826cce241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88d7db84f4364c589668c55826cce241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 2c38e2a135634a0fb0fb735c61cabf59 Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '51472512-faea-4a80-a111-082076bcb19a'} Sep 22 14:58:15.732592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. (HTTP 404) (Request-ID: req-4d784902-fbb6-4b43-b442-8a907d41cb0a) Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.733218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 14:58:15.734102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 14:58:15.735321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cff27f1b-346f-46ae-918a-1ee53a323e95 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Returning 404 to user: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cff27f1b-346f-46ae-918a-1ee53a323e95 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a" status: 404 len: 109 microversion: 2.1 time: 0.076998 Sep 22 14:58:15.737148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 14:58:15 2022] DELETE /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:58:15.746221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-85916377-3f12-4248-8afc-2ca20ed31fb1 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Calling method '.version_select at 0x7f77e7164dc0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:15.811071 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-85916377-3f12-4248-8afc-2ca20ed31fb1 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] HTTP exception thrown: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-85916377-3f12-4248-8afc-2ca20ed31fb1 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Request method failure captured: Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a HTTP/1.1 Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHf4fPgllpCWclZaxwyLQfVCMzUuvUwjbgWEdVvVikF7ykGkCDcakIHh9nLNs5Z-8EQw5SjLyddgGTLKczes82JvdYUieVE1fifNhtuI8E2PdTFil7w6A68_1iKMdllV-Rq-61x2-4_EyiwzmVA5cAFaqHzEd1sRUz2VVH1zLAzf0sw Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 14:58:15.816318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88d7db84f4364c589668c55826cce241"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88d7db84f4364c589668c55826cce241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88d7db84f4364c589668c55826cce241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 88d7db84f4364c589668c55826cce241 Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-315853629 Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 2c38e2a135634a0fb0fb735c61cabf59 Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-315853629-project Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '51472512-faea-4a80-a111-082076bcb19a'} Sep 22 14:58:15.817405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. (HTTP 404) (Request-ID: req-3749db7f-336d-478a-b086-de0afb15de02) Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.818025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 14:58:15.818951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 14:58:15.819857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. Sep 22 14:58:15.823687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:58:15.827040 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-85916377-3f12-4248-8afc-2ca20ed31fb1 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] Returning 404 to user: Volume 51472512-faea-4a80-a111-082076bcb19a could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:58:15.828137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-85916377-3f12-4248-8afc-2ca20ed31fb1 tempest-VolumesSnapshotsTestJSON-315853629 tempest-VolumesSnapshotsTestJSON-315853629-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a" status: 404 len: 109 microversion: 2.1 time: 0.088116 Sep 22 14:58:15.828909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 10/20] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:15 2022] GET /compute/v2.1/os-volumes/51472512-faea-4a80-a111-082076bcb19a => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:58:17.838588 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1926946960", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:18.187689 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] validate_networks() for [('5f14ce68-55c9-40b3-aeec-c68d94f2dd1a', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:58:18.361927 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b76a5695-123e-4424-a9f6-e1fd9820b1ef tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: .version_select at 0x7f77e71641f0>, body: {"keypair": {"name": "tempest-keypair-481126033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzZu3OY6BdFdgWs/lRwY9e6gi/Pu2JmLQGITx9pbIRhZfIitW/7wPFmJdH4Xq2U9GHF43iDd5P3Hi6ZUqTMtFZwR5p3lVqyW1vrzo3KoUEEVrC8ZWYdqGpij+kNadzm3w=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:18.524502 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-b76a5695-123e-4424-a9f6-e1fd9820b1ef tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:58:18.531960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-b76a5695-123e-4424-a9f6-e1fd9820b1ef tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:58:18.673105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b76a5695-123e-4424-a9f6-e1fd9820b1ef tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.839099 Sep 22 14:58:18.681897 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 11/21] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 14:58:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:19.974768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2062809244", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "networks": [{"uuid": "0f8459a5-39a4-4721-a771-f5c2fae6ec76"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:20.221399 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] validate_networks() for [('0f8459a5-39a4-4721-a771-f5c2fae6ec76', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:58:21.138754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:58:21.139374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:58:21.139648 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:58:21.140057 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:58:21.140481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:58:21.169575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:21.170077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:21.170527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:21.171344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:21.171803 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:21.172228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:21.237647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:58:21.252516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for user 038365d6ba7041f4af386767d98ed709 and project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:58:21.282590 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:58:21.286570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:58:21.429502 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f0ca1f08-9353-4a4f-bd4d-b0547877a0f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.329569 Sep 22 14:58:21.443391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 11/22] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:58:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 14:58:22.121816 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:58:22.122283 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:58:22.122848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:58:22.123417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:58:22.123993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:58:22.153080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:22.155651 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:22.157827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:22.160413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:22.164243 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:22.172828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-de956018-4da8-447c-a260-41c0836b44ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'create', calling method: .version_select at 0x7f77e70ecdc0>, body: {"keypair": {"name": "tempest-keypair-1981115340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlX8n/dzqUj0PfQizSD7fR5VyrjsVc9It5VBXq1umIe2Hy8sLHTQt4htib5vmu4Vbi4EhmuMZ3bhIHeTvXmfmCTqeocM4y3o+HKiC10So+fWH4wCYTRjhU+UwN1gVDOag=="}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:22.179545 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:22.270404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-de956018-4da8-447c-a260-41c0836b44ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for project aef8a9d089c9446697837d5ebe2154c8. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:58:22.278762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-de956018-4da8-447c-a260-41c0836b44ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for user 23d683cdc90041b5b29767fa2e2107e2 and project aef8a9d089c9446697837d5ebe2154c8. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:58:22.289802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Getting quotas for project d3cda271ef3244f391962778ed33c351. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:58:22.321798 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Getting quotas for user 0addaa15e4c844a5acd84c3a5e3869ff and project d3cda271ef3244f391962778ed33c351. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:58:22.380280 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:58:22.389473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:58:22.398675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-de956018-4da8-447c-a260-41c0836b44ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.953733 Sep 22 14:58:22.411447 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 12/23] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 22 14:58:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 967 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 22 14:58:22.424627 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-71b98e79-19e6-41bb-ab8e-311bf7d5e111 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:22.425579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-71b98e79-19e6-41bb-ab8e-311bf7d5e111 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:22.563552 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-af3027f5-02b7-4a47-b1d9-cc3a037266b5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.391773 Sep 22 14:58:22.564514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 12/24] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:58:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 14:58:22.578303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-caa63dcd-fea2-48bf-8ebf-80135d81de4a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:22.579298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-caa63dcd-fea2-48bf-8ebf-80135d81de4a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:22.674926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-71b98e79-19e6-41bb-ab8e-311bf7d5e111 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:22.709650 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-71b98e79-19e6-41bb-ab8e-311bf7d5e111 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1222 microversion: 2.1 time: 0.296714 Sep 22 14:58:22.716862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:22 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:22.773916 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-caa63dcd-fea2-48bf-8ebf-80135d81de4a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:22.810560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-caa63dcd-fea2-48bf-8ebf-80135d81de4a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1215 microversion: 2.1 time: 0.237598 Sep 22 14:58:22.817073 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:22 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:23.120065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-189326523", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff6bd501-2fb8-4ba1-b730-2cab6c908602"}], "security_groups": [{"name": "tempest-securitygroup--666546722"}], "key_name": "tempest-keypair-481126033", "user_data": "}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:23.388376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-249394928", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:23.433154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] validate_networks() for [('ff6bd501-2fb8-4ba1-b730-2cab6c908602', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:58:23.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] validate_networks() for [('5f14ce68-55c9-40b3-aeec-c68d94f2dd1a', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:58:25.939045 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:58:25.939731 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:58:25.940355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:58:25.940876 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:58:25.941397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:58:25.962213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:25.966330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:58:25.966960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:58:25.967586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:58:25.968108 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:58:25.968633 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:58:25.980708 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:25.981275 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:25.982637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:25.986606 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:25.988530 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:25.992631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:25.994998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:25.995744 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:25.998342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:25.999076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:26.004434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:26.062120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:58:26.073263 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for user 038365d6ba7041f4af386767d98ed709 and project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:58:26.076690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:58:26.090579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:58:26.104733 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:58:26.111659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:58:26.124269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:58:26.131080 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:58:26.233200 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d4bd308f-d752-4084-90aa-ef828da1a8f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.854232 Sep 22 14:58:26.234177 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 14/27] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:58:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 14:58:26.239011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:26.239627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:26.264814 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:26.265420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:26.265721 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:26.266435 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:26.266917 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:26.267339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:26.268714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8d176444-1d9b-4c9f-ad0b-7d4540197af4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.153096 Sep 22 14:58:26.277083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 14/28] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:58:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 3162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 14:58:26.282774 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-06ab125c-eed3-4f89-8eb5-538cb9ef71a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:26.283770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-06ab125c-eed3-4f89-8eb5-538cb9ef71a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:26.371433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-06ab125c-eed3-4f89-8eb5-538cb9ef71a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:26.384426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-06ab125c-eed3-4f89-8eb5-538cb9ef71a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1221 microversion: 2.1 time: 0.105857 Sep 22 14:58:26.388814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:26 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:26.402655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2d7390c3-9479-4c84-9930-3789859428d0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:26.404676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2d7390c3-9479-4c84-9930-3789859428d0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:26.599178 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2d7390c3-9479-4c84-9930-3789859428d0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:26.612113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2d7390c3-9479-4c84-9930-3789859428d0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1240 microversion: 2.1 time: 0.220536 Sep 22 14:58:26.618482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 16/30] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:26 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1240 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:26.993207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:27.024157 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-873d8a48-a701-46f0-ae37-73fcd6748aa1 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1211 microversion: 2.1 time: 0.787103 Sep 22 14:58:27.046381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 15/31] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:26 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1211 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:27.130598 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8aabfa53-2f1a-444a-9c96-4899618aa089 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e672dee0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:27.267213 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8aabfa53-2f1a-444a-9c96-4899618aa089 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c437d972-0f21-46bf-a624-80cdac872e5f" status: 200 len: 351 microversion: 2.1 time: 0.139375 Sep 22 14:58:27.267960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:27 2022] GET /compute/v2.1/os-volumes/c437d972-0f21-46bf-a624-80cdac872e5f => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:27.419183 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-690e4538-013c-45e4-9d90-cf9036d8c0cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:27.420144 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-690e4538-013c-45e4-9d90-cf9036d8c0cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:27.611633 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1778131801", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8742f16c-32ab-48fd-81ef-195b3c65c9b9"}], "security_groups": [{"name": "tempest-securitygroup--124344094"}], "key_name": "tempest-keypair-1981115340", "user_data": "}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:27.838375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-690e4538-013c-45e4-9d90-cf9036d8c0cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:27.852047 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-690e4538-013c-45e4-9d90-cf9036d8c0cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1221 microversion: 2.1 time: 0.438504 Sep 22 14:58:27.857235 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 16/33] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:27 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1221 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:27.879178 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:27.885852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:27.911508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:27.911830 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:27.913327 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:27.915079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:27.915958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:27.917897 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:28.361417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:28.375654 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d2d5c183-03bc-4e3a-9d06-547243259dee tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1244 microversion: 2.1 time: 0.514370 Sep 22 14:58:28.392263 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 17/34] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:27 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1244 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:28.405620 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:28.407097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] validate_networks() for [('8742f16c-32ab-48fd-81ef-195b3c65c9b9', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:58:28.409278 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:28.455997 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:28.457637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:28.458184 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:28.461914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:28.463126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:28.463569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:28.761049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:28.775043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-809b9d47-58af-442f-a802-df8eac9a9a35 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1273 microversion: 2.1 time: 0.378543 Sep 22 14:58:28.775647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 18/35] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:28 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:28.886420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:28.888137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:28.901275 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:28.901766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:28.909876 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:28.912552 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:28.914352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:28.918010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:29.712304 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:29.721201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cefb80da-1120-4b15-9d73-55093e2ada05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1217 microversion: 2.1 time: 0.840652 Sep 22 14:58:29.740230 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 19/36] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:28 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1217 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:29.758900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:29.766639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:29.807081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:29.812206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:29.828644 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:29.829734 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:29.830443 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:29.831121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:30.833440 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:30.850142 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-98df37b3-d9c2-4169-80dc-c4cc737d80c1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1298 microversion: 2.1 time: 1.107848 Sep 22 14:58:30.857306 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 20/37] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:29 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1298 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:30.874924 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-24799178-971f-4ea5-b144-efa2ccc78eee tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e6692af0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:31.120723 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-24799178-971f-4ea5-b144-efa2ccc78eee tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4c195ea3-3633-4eb6-bad0-ef7310021379" status: 200 len: 350 microversion: 2.1 time: 0.261921 Sep 22 14:58:31.121473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 21/38] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:30 2022] GET /compute/v2.1/os-volumes/4c195ea3-3633-4eb6-bad0-ef7310021379 => generated 350 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:31.126492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:31.127328 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:31.151715 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:31.156833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:31.158625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:31.162281 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:31.164187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:31.165228 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:31.722848 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:58:31.723377 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:58:31.723732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:58:31.726250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:58:31.728144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:58:31.744475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:31.745264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:31.745874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:31.746870 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:31.747609 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:31.748533 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:31.753065 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:31.779753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d6c4be21-507d-498d-814a-7423ef800ce9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.655293 Sep 22 14:58:31.800852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:31 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:31.809430 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:31.811386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:31.818908 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:31.821014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:31.821979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:31.822977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:31.824129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:31.824788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:31.837301 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for project aef8a9d089c9446697837d5ebe2154c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:58:31.848826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for user 23d683cdc90041b5b29767fa2e2107e2 and project aef8a9d089c9446697837d5ebe2154c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:58:31.879296 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:58:31.885333 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:58:31.972203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:31.984786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-84acd262-c3d7-48eb-a084-26d4e352ba43 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.377604 Sep 22 14:58:31.986667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 18/40] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 22 14:58:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 4382 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 22 14:58:31.988348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-430e5cf6-2ca4-4d55-b791-1252b4de0cdd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1279 microversion: 2.1 time: 0.182626 Sep 22 14:58:31.989461 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 23/41] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:31 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:31.999463 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:32.001065 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9f61aa13-5f13-4ffe-ac06-46e0433d07bb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:32.001892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:32.005646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9f61aa13-5f13-4ffe-ac06-46e0433d07bb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:32.019562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:32.020400 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:32.021031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:32.021542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:32.021998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:32.023189 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:32.147687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9f61aa13-5f13-4ffe-ac06-46e0433d07bb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:32.159337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9f61aa13-5f13-4ffe-ac06-46e0433d07bb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:32.162582 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9f61aa13-5f13-4ffe-ac06-46e0433d07bb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:32.170791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9f61aa13-5f13-4ffe-ac06-46e0433d07bb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1282 microversion: 2.20 time: 0.170761 Sep 22 14:58:32.171809 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 24/42] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:31 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:32.234948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:32.256805 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9fe7e536-8355-48a5-9da0-21a21a0b3663 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1298 microversion: 2.1 time: 0.268351 Sep 22 14:58:32.258148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 19/43] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:31 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1298 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:32.811175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:32.811696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:32.819605 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:32.820478 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:32.821098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:32.822753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:32.823395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:32.824021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:32.990542 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:32.999528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-982fb870-2533-4f0b-99bc-15fd90272a8b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.192428 Sep 22 14:58:33.001137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 25/44] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:32 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:33.013515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:33.014130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:33.039269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:33.040154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:33.040882 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:33.041879 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:33.042495 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:33.043073 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:33.155327 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:33.167575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-22993671-3700-4e82-ae62-77629304e203 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1279 microversion: 2.1 time: 0.158077 Sep 22 14:58:33.168786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 20/45] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:33 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:33.199872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:33.201152 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:33.208844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:33.209498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:33.210118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:33.211323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:33.212219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:33.213007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:33.294282 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:33.294955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:33.301838 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:33.312613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:33.313759 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:33.314291 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:33.314430 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:33.314820 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:33.315546 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:33.316009 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:33.316443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:33.316836 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-32a58e22-055e-49da-a6d4-b4fe877cd920 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1286 microversion: 2.20 time: 0.122643 Sep 22 14:58:33.317416 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 26/46] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:33 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:33.417998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:33.430570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4b891399-5ac2-43e6-961f-edb4d43549e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1298 microversion: 2.1 time: 0.153769 Sep 22 14:58:33.431752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 21/47] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:33 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:34.025415 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:34.027901 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:34.036186 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.037267 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.037872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.039639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.040097 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.040536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.128475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a4723623-494e-4cae-a3f3-bd255d1a5b5c tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e6691430>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:34.250170 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a4723623-494e-4cae-a3f3-bd255d1a5b5c tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4e6df917-6d10-4d52-82fc-0cf55d79fb8f" status: 200 len: 350 microversion: 2.1 time: 0.125961 Sep 22 14:58:34.251437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 22/48] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/os-volumes/4e6df917-6d10-4d52-82fc-0cf55d79fb8f => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 14:58:34.256383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:34.258325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:34.265572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.266072 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.266513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.267265 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.267781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.268218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.316914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:34.336028 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9052a866-276a-462e-9a99-46c9513bca00 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.315311 Sep 22 14:58:34.336617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 27/49] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:34.346853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d14e6f7a-873d-4585-88b4-66442ed3e3e0 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e666eaf0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:34.463449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:34.484103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f6cd1f46-b907-451e-88fd-a92e5d3313a0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1279 microversion: 2.1 time: 0.231126 Sep 22 14:58:34.485124 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 23/50] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:34.511646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:34.513406 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:34.531735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.532527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.535927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.537452 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.539803 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.540444 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.551188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d14e6f7a-873d-4585-88b4-66442ed3e3e0 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.210842 Sep 22 14:58:34.552439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 28/51] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:34.562635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:34.564441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:34.592803 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.596355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.598192 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.603133 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:34.603635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:34.604072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:34.721145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:34.734557 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:34.736148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:34.741655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9f57bb8c-6090-4349-b91c-ad92e68a67bd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1286 microversion: 2.20 time: 0.239414 Sep 22 14:58:34.760138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 24/52] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1286 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:34.760138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ef752114-2e26-45c1-8596-212bea9de58c tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e6683d30>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:34.799252 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:34.812342 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ae17226d-3708-4c3f-94d1-5be24d8e95ab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1298 microversion: 2.1 time: 0.258614 Sep 22 14:58:34.816882 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 29/53] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1298 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:34.881488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ef752114-2e26-45c1-8596-212bea9de58c tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.136591 Sep 22 14:58:34.881488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 25/54] 10.222.0.26 () {58 vars in 1149 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:34.898484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-37f597f5-4f3c-49b9-af50-2c3ffcd0e045 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e673c940>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.017428 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-37f597f5-4f3c-49b9-af50-2c3ffcd0e045 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.123621 Sep 22 14:58:35.018682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 30/55] 10.222.0.26 () {58 vars in 1134 bytes} [Thu Sep 22 14:58:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:35.034084 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ccbf8d29-fb6a-44d5-bc74-0f60e2ed0f7a tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e6691d30>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.161395 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ccbf8d29-fb6a-44d5-bc74-0f60e2ed0f7a tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.131945 Sep 22 14:58:35.177501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b1b6fb0d-f18d-45bc-970c-f05ff53beb16 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e6692dc0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.180203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 26/56] 10.222.0.26 () {58 vars in 1167 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:35.363802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b1b6fb0d-f18d-45bc-970c-f05ff53beb16 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.190211 Sep 22 14:58:35.365980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 31/57] 10.222.0.26 () {58 vars in 1170 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:35.367238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.368163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:35.379811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-55918b8e-f254-4f2c-a7df-7424d2581ebd tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e6638040>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.387101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.387553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.389814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.390571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.398930 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.399870 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.568241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-55918b8e-f254-4f2c-a7df-7424d2581ebd tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.192127 Sep 22 14:58:35.569232 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 32/58] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:35.583613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.585073 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:35.601151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.602946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.606268 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.607498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.608273 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.610327 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.703084 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:35.717988 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-150f6b64-a027-47c3-a110-556a4c5875c4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.357974 Sep 22 14:58:35.719496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 27/59] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:35.738973 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dec8e9f6-7ae7-4baa-a86a-c7d20ccaab99 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e67415e0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.776054 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:35.784594 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5964c7b9-b0ed-4226-94cd-837f9202a678 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1279 microversion: 2.1 time: 0.205060 Sep 22 14:58:35.799617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 33/60] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1279 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:35.813076 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.820191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:35.838018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.838234 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.842640 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.845117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.845618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.846645 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.948097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dec8e9f6-7ae7-4baa-a86a-c7d20ccaab99 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.226774 Sep 22 14:58:35.948830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 28/61] 10.222.0.26 () {58 vars in 1188 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:35.954550 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:35.955418 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:35.960969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:35.967501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.968310 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.969083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.970455 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:35.971220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:35.973984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:35.975739 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:35.977452 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:35.978795 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5bfa2886-7661-4ad8-b5cf-c6aa9ebf36d1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1286 microversion: 2.20 time: 0.177819 Sep 22 14:58:35.979524 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 34/62] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:35.984308 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-661abbcc-d624-4418-9d42-6ff83321af70 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] Calling method '.version_select at 0x7f77e666eaf0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:36.023077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=4 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:36.061055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:36.070279 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c1eaf8b7-85eb-4f64-8f51-003b5952db26 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1298 microversion: 2.1 time: 0.119806 Sep 22 14:58:36.079626 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 29/63] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:36.097089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-661abbcc-d624-4418-9d42-6ff83321af70 tempest-VolumesTestJSON-805704591 tempest-VolumesTestJSON-805704591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.116343 Sep 22 14:58:36.097686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 35/64] 10.222.0.26 () {58 vars in 1155 bytes} [Thu Sep 22 14:58:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:36.751991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:36.756934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:36.774670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:36.775191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:36.779378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:36.780785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:36.784834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:36.785439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:36.817257 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:36.817979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:36.835804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:36.840506 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:36.841151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:36.841913 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:36.847201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:36.847702 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:37.269245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:37.284873 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dada88ec-adc2-4900-9bda-5f80debe58a4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.472109 Sep 22 14:58:37.291046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:37.340560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 36/65] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:36 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:37.357176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ce6bad94-260f-43b5-aa07-a646609e67e3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.608742 Sep 22 14:58:37.358053 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:37.359641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 30/66] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:36 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:37.365539 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:37.385452 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:37.386908 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:37.389264 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:37.389852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:37.390304 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:37.391044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:37.391611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:37.391912 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:37.403731 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:37.413056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:37.416531 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:37.420086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:37.422520 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:37.423325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:37.500593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:37.521939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:37.527827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:37.532554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bc6614ee-50ec-4c0c-8306-d26620a20e17 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1286 microversion: 2.20 time: 0.188933 Sep 22 14:58:37.545087 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 37/67] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:37 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:37.588421 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:37.655186 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f58f47d3-b4e1-4a60-be09-876453192e2d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1298 microversion: 2.1 time: 0.272956 Sep 22 14:58:37.667139 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 31/68] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:37 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1298 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:38.335720 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:38.336954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:38.362012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:38.375501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:38.378704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:38.381593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:38.382124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:38.385815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:38.386451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:38.400404 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:38.400603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:38.411559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:38.412187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:38.419430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:38.419931 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:38.420353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:39.707309 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:39.710811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:39.720011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e24bd3e3-5527-454b-aa97-e8bbeb0dfb32 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 1.400857 Sep 22 14:58:39.720788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 38/69] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:38 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:39.728646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:39.729564 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:39.737293 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:39.748845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:39.751727 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:39.753004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:39.754725 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:39.756488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:39.842683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:39.853158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3e0b087b-678a-498f-8c6a-5baa34ba5c82 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 1.471046 Sep 22 14:58:39.859196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 32/70] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:38 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:39.889258 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:39.891374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:39.904565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:39.912978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:39.912978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:39.912978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:39.912978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:39.913645 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:40.174749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:40.184903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:40.194639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:40.204537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-37a56bc9-5daa-439b-8f8c-a76efefcf4e1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1334 microversion: 2.20 time: 0.481928 Sep 22 14:58:40.219982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 39/71] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:39 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1334 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:40.231191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:40.262529 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a22a0ae3-df63-4d75-9536-4330ce049b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1298 microversion: 2.1 time: 0.394635 Sep 22 14:58:40.267702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 33/72] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:39 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1298 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:40.745320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:40.746571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:40.758682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:40.771159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:40.771621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:40.772894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:40.773350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:40.773770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:40.881675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:40.882287 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:40.917863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:40.920302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:40.921177 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:40.921863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:40.922836 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:40.923622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:40.924237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:41.356251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:41.391417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-36e11c5b-7765-4662-b5af-ec08a3425c18 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.493482 Sep 22 14:58:41.413647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 34/73] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:40 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:41.440142 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:41.440816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:41.458410 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:41.462351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:41.464556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:41.467174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:41.469358 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:41.471552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:41.766152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=6 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:41.865006 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=28 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:42.112579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:42.118427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=83 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:42.134021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:42.146364 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:42.148746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-de8c7a64-b317-4d3a-9e61-d391f4948a9a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1340 microversion: 2.20 time: 0.731649 Sep 22 14:58:42.153365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=22 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:42.155657 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 35/74] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:41 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1340 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:42.170906 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:42.173353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:42.190982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:42.194300 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:42.198976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:42.199938 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:42.201177 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:42.204643 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:42.241573 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:42.257140 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3ee0191a-ae87-42dc-9041-6bfa8a844a7c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 1.516062 Sep 22 14:58:42.266812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 40/75] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:40 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:42.471027 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-d79c7afb-572c-43ea-9401-1c9758410e53 req-0fed8dda-c93e-41a4-9b65-de18f563d45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cdb9447-4895-42dd-bb76-06ef6acb90fe", "tag": "1daa1a28-9862-4383-a61c-cba96eedcb29"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:42.487860 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d79c7afb-572c-43ea-9401-1c9758410e53 req-0fed8dda-c93e-41a4-9b65-de18f563d45f service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:42.488557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d79c7afb-572c-43ea-9401-1c9758410e53 req-0fed8dda-c93e-41a4-9b65-de18f563d45f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:42.489125 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d79c7afb-572c-43ea-9401-1c9758410e53 req-0fed8dda-c93e-41a4-9b65-de18f563d45f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:42.519522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-d79c7afb-572c-43ea-9401-1c9758410e53 req-0fed8dda-c93e-41a4-9b65-de18f563d45f service nova] Creating event network-changed:1daa1a28-9862-4383-a61c-cba96eedcb29 for instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe on hv-cinder-84456 Sep 22 14:58:42.520462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d79c7afb-572c-43ea-9401-1c9758410e53 req-0fed8dda-c93e-41a4-9b65-de18f563d45f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 14:58:42.521068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d79c7afb-572c-43ea-9401-1c9758410e53 req-0fed8dda-c93e-41a4-9b65-de18f563d45f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 14:58:42.522360 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:42.523973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:42.525765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:42.528382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:42.529131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:42.533151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:42.548623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.compute.rpcapi [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 14:58:42.549909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 14:58:42.579141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a7f64e67-953d-4342-b43e-3ea947009cb6 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306608 Sep 22 14:58:42.579141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 41/76] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:42.587108 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:42.593528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:42.610546 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:42.611224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:42.612012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:42.613658 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:42.614400 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:42.616538 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:42.978183 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:42.991017 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9d3ef5be-dadf-4670-9435-f6f8be07c0ff tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.413626 Sep 22 14:58:42.991679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 42/77] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:42 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:43.191420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:43.194348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:43.215485 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:43.219078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:43.219925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:43.222606 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:43.225752 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:43.233504 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:43.359066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:43.377948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-00663970-4c2f-4bd2-913e-87a6247a268b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 1.220977 Sep 22 14:58:43.385287 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 36/78] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:42 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:43.405901 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:43.406555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:43.420002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:43.420492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:43.422822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:43.424138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:43.427944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:43.429115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:43.689663 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:43.704301 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:43.706795 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:43.708132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b8f62974-ed06-4c37-8eb6-eb0f6090bc1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1340 microversion: 2.20 time: 0.527928 Sep 22 14:58:43.712110 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 43/79] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:43 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1340 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:44.039286 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-01ddd965-fabc-45d9-9b78-fcd6287fc64a req-f9173f22-4ddd-4bb5-bcdb-e888b347eace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a790f1f1-dcd3-4803-9265-6802b65359bb", "tag": "2b1dceeb-de37-4a4e-a536-1fcee2278f4c"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:44.047354 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:44.058527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:44.069631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-38e00c6c-2f40-4c78-8f82-e409933e6175 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.675675 Sep 22 14:58:44.071262 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 37/80] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:43 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:44.087876 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:44.088495 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:44.102314 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:44.102836 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:44.103339 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:44.104110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:44.104563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:44.104987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:44.106394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-01ddd965-fabc-45d9-9b78-fcd6287fc64a req-f9173f22-4ddd-4bb5-bcdb-e888b347eace service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:44.107563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-01ddd965-fabc-45d9-9b78-fcd6287fc64a req-f9173f22-4ddd-4bb5-bcdb-e888b347eace service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:44.108934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-01ddd965-fabc-45d9-9b78-fcd6287fc64a req-f9173f22-4ddd-4bb5-bcdb-e888b347eace service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:44.142433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-01ddd965-fabc-45d9-9b78-fcd6287fc64a req-f9173f22-4ddd-4bb5-bcdb-e888b347eace service nova] Creating event network-changed:2b1dceeb-de37-4a4e-a536-1fcee2278f4c for instance a790f1f1-dcd3-4803-9265-6802b65359bb on hv-cinder-84456 Sep 22 14:58:44.160477 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-01ddd965-fabc-45d9-9b78-fcd6287fc64a req-f9173f22-4ddd-4bb5-bcdb-e888b347eace service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.445949 Sep 22 14:58:44.164205 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 44/81] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:44.408797 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:44.409587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:44.423098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:44.426901 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:44.438691 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:44.440837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:44.442375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:44.445459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:44.688719 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:44.707655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9d210377-db62-454b-86ce-7c6f5a26938d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.634648 Sep 22 14:58:44.711677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 38/82] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:44 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:44.744890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:44.747612 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:44.757375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:44.758119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:44.759044 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:44.760069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:44.761061 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:44.762321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.071069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:45.089863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dc31e994-36d6-4c91-ae65-6de9747aad68 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.684204 Sep 22 14:58:45.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 45/83] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:44 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:45.112205 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:45.113323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:45.132531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:45.133271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:45.134698 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.136816 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:45.138063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:45.140510 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.269018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:45.284948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:45.289337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:45.292778 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a44904ca-3512-4c3e-8ec2-1f20bb4253fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.556702 Sep 22 14:58:45.294746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 39/84] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:44 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:45.376238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-f6114e0f-b446-4ba3-ad9c-05d882e0895f req-08975e95-8e93-4e01-9b42-270d941bc5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5971c6-d2d8-4674-a079-4a4856e13fb6", "tag": "331bff57-f783-4dec-bed0-6844457674e1"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:45.391868 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f6114e0f-b446-4ba3-ad9c-05d882e0895f req-08975e95-8e93-4e01-9b42-270d941bc5f9 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:45.392825 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f6114e0f-b446-4ba3-ad9c-05d882e0895f req-08975e95-8e93-4e01-9b42-270d941bc5f9 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:45.394877 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f6114e0f-b446-4ba3-ad9c-05d882e0895f req-08975e95-8e93-4e01-9b42-270d941bc5f9 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.429703 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:45.443120 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-f6114e0f-b446-4ba3-ad9c-05d882e0895f req-08975e95-8e93-4e01-9b42-270d941bc5f9 service nova] Creating event network-changed:331bff57-f783-4dec-bed0-6844457674e1 for instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 on hv-cinder-84456 Sep 22 14:58:45.443297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3de1414c-54c4-49af-9232-0cdf2ef90f69 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.347488 Sep 22 14:58:45.450833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 46/85] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:45 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:45.452847 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f6114e0f-b446-4ba3-ad9c-05d882e0895f req-08975e95-8e93-4e01-9b42-270d941bc5f9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120694) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 14:58:45.454681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f6114e0f-b446-4ba3-ad9c-05d882e0895f req-08975e95-8e93-4e01-9b42-270d941bc5f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120694) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 14:58:45.456433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:45.457964 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:45.458564 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.461521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:45.462449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:45.463154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.496015 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.compute.rpcapi [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 14:58:45.497066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] Releasing lock "compute-rpcapi-router" {{(pid=120694) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 14:58:45.529960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c2e2bba9-4ff0-437e-a7b0-54ca102c8905 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156146 Sep 22 14:58:45.535694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 40/86] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:45.735652 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:45.736365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:45.742889 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:45.744060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:45.744568 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.745684 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:45.746276 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:45.746857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:45.910776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:45.919297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9d9b2959-1599-45a4-9f42-c615b0cdff45 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.187803 Sep 22 14:58:45.936080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 47/87] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:45 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:46.117511 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:46.118884 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:46.125822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.126577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.127416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.128325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.128869 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.129469 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.224170 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-e3433545-5ce0-4030-88d2-2e015560de0b req-bcbcf000-cf0d-4e9b-9d4e-12e7772b9b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9275db0b-6903-400e-a766-1cb9effeedf1", "tag": "03ac6268-6935-466d-836e-bd953370c34d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:46.245165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e3433545-5ce0-4030-88d2-2e015560de0b req-bcbcf000-cf0d-4e9b-9d4e-12e7772b9b22 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.245650 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e3433545-5ce0-4030-88d2-2e015560de0b req-bcbcf000-cf0d-4e9b-9d4e-12e7772b9b22 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.246326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e3433545-5ce0-4030-88d2-2e015560de0b req-bcbcf000-cf0d-4e9b-9d4e-12e7772b9b22 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.266479 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-e3433545-5ce0-4030-88d2-2e015560de0b req-bcbcf000-cf0d-4e9b-9d4e-12e7772b9b22 service nova] Creating event network-changed:03ac6268-6935-466d-836e-bd953370c34d for instance 9275db0b-6903-400e-a766-1cb9effeedf1 on hv-cinder-84456 Sep 22 14:58:46.272641 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-e3433545-5ce0-4030-88d2-2e015560de0b req-bcbcf000-cf0d-4e9b-9d4e-12e7772b9b22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058719 Sep 22 14:58:46.274251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 48/88] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:46.324702 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:46.325408 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:46.334080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.335482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.336120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.336826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.337429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.338094 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.473053 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:46.480916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4447d8cb-c6c0-4044-9925-1d43fd93a9b6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.368886 Sep 22 14:58:46.495090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 41/89] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:46 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:46.502527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:46.503682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:46.511962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.512727 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.513398 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.514353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.515046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.515687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.545887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:46.555738 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:46.563350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:46.565847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-97bc0593-06f4-407e-9201-03082a64fcf7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.245741 Sep 22 14:58:46.566990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 49/90] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:46 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:46.712745 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:46.721407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ebf4820e-e127-4367-a8d0-4c502d103f50 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.224830 Sep 22 14:58:46.721904 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 42/91] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:46 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:46.946042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:46.946042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:46.953965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.954578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.955074 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:46.955813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:46.956271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:46.956799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:47.117357 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:47.126291 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8fac0e5d-fb67-490a-a589-99731a92b9a8 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.186572 Sep 22 14:58:47.127083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 50/92] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:46 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:47.507350 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:47.507964 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:47.514338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:47.514947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:47.515392 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:47.516097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:47.516553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:47.516989 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:47.593023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:47.595962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:47.602852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:47.603347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:47.603780 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:47.604682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:47.605132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:47.605555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:47.690852 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:47.700561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cebcd36f-619a-402a-aa51-61dd273e8531 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.196911 Sep 22 14:58:47.701076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 43/93] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:47 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:47.746942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:47.748338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:47.757167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:47.757784 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:47.758502 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:47.759360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:47.760099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:47.760715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:47.777075 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:47.786173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:47.787764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:47.789575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-afa32098-24af-484e-b0b2-e68b59295e65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.201052 Sep 22 14:58:47.790783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 51/94] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:47 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:47.902651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:47.911612 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0c36e9bb-d44a-47f1-b065-7f060c191fb0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.170676 Sep 22 14:58:47.912299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 44/95] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:47 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:48.158869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:48.160218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:48.172084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:48.173389 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:48.175374 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:48.176996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:48.179571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:48.180496 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:48.723713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:48.724334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:48.731060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:48.731657 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:48.732450 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:48.734017 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:48.734592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:48.735079 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:48.766408 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:48.776244 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7844d932-2cc3-4bc4-9f28-8ad34e734416 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.626831 Sep 22 14:58:48.787162 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 52/96] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:48 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:48.846314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:48.847004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:48.875009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:48.875494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:48.876101 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:48.876983 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:48.877583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:48.878167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:49.424819 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:49.434831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f8c6a020-27de-4840-ba6b-42c828b8564b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.715039 Sep 22 14:58:49.441826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 45/97] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:48 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:49.453883 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:49.454694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:49.455966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:49.467942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:49.468712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:49.469337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:49.475052 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:49.476787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:49.477457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:49.478099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:49.480906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:49.494636 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7672e48c-8b39-46de-83d9-982b5112eacf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.672905 Sep 22 14:58:49.515440 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 53/98] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:48 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:49.799152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:49.801704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:49.802406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:49.816734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1bf203e6-49e8-4f9c-88f9-639da92c216c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.373563 Sep 22 14:58:49.818269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 46/99] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:49 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:49.826845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:49.827487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:49.828011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:49.828833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:49.829490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:49.830517 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:50.002589 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:50.012166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7049511a-c9d7-462a-a380-99f919ac3060 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.214535 Sep 22 14:58:50.012757 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 54/100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:49 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:50.093573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-2bc85113-0f2f-4bb2-a0f0-4fda75978471 req-daca9c72-d0fc-472b-a7f2-5c03a23dcf22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45e6623-9952-42a0-b01e-85001ae14fd2", "tag": "ecbef20d-ee6a-4cae-8583-7ab49d776a37"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:50.105060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2bc85113-0f2f-4bb2-a0f0-4fda75978471 req-daca9c72-d0fc-472b-a7f2-5c03a23dcf22 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:50.105541 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2bc85113-0f2f-4bb2-a0f0-4fda75978471 req-daca9c72-d0fc-472b-a7f2-5c03a23dcf22 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:50.105969 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2bc85113-0f2f-4bb2-a0f0-4fda75978471 req-daca9c72-d0fc-472b-a7f2-5c03a23dcf22 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:50.159478 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-2bc85113-0f2f-4bb2-a0f0-4fda75978471 req-daca9c72-d0fc-472b-a7f2-5c03a23dcf22 service nova] Creating event network-changed:ecbef20d-ee6a-4cae-8583-7ab49d776a37 for instance c45e6623-9952-42a0-b01e-85001ae14fd2 on hv-cinder-84456 Sep 22 14:58:50.166603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-2bc85113-0f2f-4bb2-a0f0-4fda75978471 req-daca9c72-d0fc-472b-a7f2-5c03a23dcf22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078845 Sep 22 14:58:50.168311 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 47/101] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:50.463576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:50.464547 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:50.471093 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:50.472098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:50.472768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:50.473686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:50.474381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:50.475068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:50.545573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:50.546265 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:50.553536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:50.554407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:50.554909 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:50.555762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:50.556215 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:50.556632 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:50.683209 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:50.691224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c443c6d8-af87-408f-837d-77a99399d83d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.231524 Sep 22 14:58:50.691964 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 55/102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:50 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:50.752224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:50.765520 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:50.767047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:50.770196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-910b5e63-55cc-40e0-9dd2-5479bf0aa472 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.229499 Sep 22 14:58:50.770804 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 48/103] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:50 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:50.843004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:50.844135 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:50.853446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:50.854064 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:50.854586 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:50.855378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:50.855892 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:50.856325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:51.032869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:51.041586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:51.042060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a964062c-f1b0-4cfc-9e95-d14a1e4d4485 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.204473 Sep 22 14:58:51.042247 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 56/104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:50 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:51.042627 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:51.050660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:51.051542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:51.052344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:51.053831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:51.054544 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:51.055290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:51.222610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:51.231610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-24fab711-53e7-4959-9d4a-809f9a23666e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.198599 Sep 22 14:58:51.232505 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 49/105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:51 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:51.718617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:51.719299 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:51.725810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:51.726369 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:51.726927 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:51.727695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:51.728225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:51.728722 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:51.732863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:51.796056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:51.796667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:51.806083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:51.806568 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:51.807021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:51.807876 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:51.808331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:51.808751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:51.939800 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:51.950725 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f18a58cc-724e-4d99-a2da-0d5970f6772b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.235866 Sep 22 14:58:51.963043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 57/106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:51 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:51.982450 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:51.991110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:51.992571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:51.993702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9978773b-f7c8-4242-892b-555d97a32298 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.201802 Sep 22 14:58:51.994416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 50/107] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:51 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:52.065866 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:52.066481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:52.072712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:52.073198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:52.073625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:52.074317 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:52.074960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:52.075382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:52.242137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:52.250473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9859f766-6460-4ba8-aba5-d4c8b0aa0f08 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.188440 Sep 22 14:58:52.258649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:52.259826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:52.263231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 58/108] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:52 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:52.267165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:52.268271 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:52.268712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:52.269427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:52.269882 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:52.270310 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:52.425721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:52.434463 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-403daae4-5ae5-41db-bc29-8b85fe1a4f0f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.180704 Sep 22 14:58:52.435065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 51/109] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:52 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:52.973837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:52.974481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:52.976721 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:52.982470 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:52.983053 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:52.983491 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:52.984191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:52.984639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:52.985062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:53.017481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:53.018011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:53.027476 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:53.028018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:53.028553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:53.029468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:53.030188 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:53.030666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:53.207938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:53.215364 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:53.216577 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a17b68ef-9bf4-4b61-8fac-bd9f5c8d9b88 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.246726 Sep 22 14:58:53.217154 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 59/110] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:52 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:53.224388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:53.225838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:53.227003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1b77f54d-3c55-4900-be0f-3ab08c72bc2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.213319 Sep 22 14:58:53.230782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 52/111] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:53 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:53.274321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:53.274979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:53.281468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:53.281960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:53.282397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:53.283125 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:53.283583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:53.284008 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:53.432652 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:53.441163 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0f706aa7-cb0a-4572-8256-d7e54af1c6d2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.171564 Sep 22 14:58:53.441802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 60/112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:53 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:53.457290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:53.458101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:53.464093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:53.464765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:53.465618 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:53.466486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:53.466966 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:53.467399 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:53.483801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:53.611359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:53.619825 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5262417c-50cb-498b-807a-6de51c480c23 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.166248 Sep 22 14:58:53.620471 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 53/113] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:53 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:54.244896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:54.245618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:54.252295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:54.253175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:54.269011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.270985 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.272592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.273284 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.274095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.275100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.275768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.278497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.279236 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.279917 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.280550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.283249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.604965 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:54.618711 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:54.621530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:54.625050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-010020d8-c5b7-4675-bb4f-0c429ca7a9ac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.376705 Sep 22 14:58:54.629055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 54/114] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:54 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:54.634547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:54.635185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:54.648044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:54.658709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-598a236a-5df7-457e-a9c2-7d6e85861780 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.416148 Sep 22 14:58:54.659467 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 61/115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:54 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:54.674127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.674127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.674127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.674127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.674606 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.674606 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.674793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:54.674793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:54.688497 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.689163 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.689604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.690933 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:54.691258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:54.691678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:54.975608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:54.987939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:54.994284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a3d72a5a-4a2c-4039-8f9d-5bfa8ea9d60b tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.331078 Sep 22 14:58:54.995415 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 62/116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:54 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:55.001416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5551c0ac-02ac-4ec6-ac63-9d041acafa67 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.370907 Sep 22 14:58:55.007188 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 55/117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:54 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:55.655474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:55.656149 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:55.665973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:55.683575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:55.684203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:55.689675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:55.690215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:55.690989 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:55.691460 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:55.692947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:58:55.694521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:55.695022 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:55.695370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:55.697147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:55.697871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:55.698369 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:55.702225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:55.988105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:55.998433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-84b8f200-7b2a-436a-9a95-486532561e3b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.320872 Sep 22 14:58:56.001214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 56/118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:55 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:56.015764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:56.017962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:56.018579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:56.029124 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:56.034525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:56.036292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:56.036595 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:56.038481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:56.039764 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:56.044494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:56.050302 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:56.054550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0c8a087c-d5ac-418f-898e-6dd40d5dadea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.403105 Sep 22 14:58:56.057040 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 63/119] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:55 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:56.069435 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:56.074655 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:56.083591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:56.086839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:56.091787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:56.095479 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:56.096406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:56.097000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:56.673924 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:56.688372 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-78b56d3d-f489-49af-af83-d9ab2c7ea73a tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.673804 Sep 22 14:58:56.694401 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:56.702959 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ef9708b4-2333-4749-b75b-c76a9e1c960d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.644273 Sep 22 14:58:56.705277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 57/120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:56 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:56.706631 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 64/121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:56 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:56.830865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-ef8153c6-d907-4eeb-a68b-adf2ef6f444d req-700bfea0-c750-4207-9017-bbbbd771fec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdb9447-4895-42dd-bb76-06ef6acb90fe", "name": "network-vif-plugged", "status": "completed", "tag": "1daa1a28-9862-4383-a61c-cba96eedcb29"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:56.857764 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ef8153c6-d907-4eeb-a68b-adf2ef6f444d req-700bfea0-c750-4207-9017-bbbbd771fec2 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:56.858248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ef8153c6-d907-4eeb-a68b-adf2ef6f444d req-700bfea0-c750-4207-9017-bbbbd771fec2 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:56.858706 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ef8153c6-d907-4eeb-a68b-adf2ef6f444d req-700bfea0-c750-4207-9017-bbbbd771fec2 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:56.883252 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-ef8153c6-d907-4eeb-a68b-adf2ef6f444d req-700bfea0-c750-4207-9017-bbbbd771fec2 service nova] Creating event network-vif-plugged:1daa1a28-9862-4383-a61c-cba96eedcb29 for instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe on hv-cinder-84456 Sep 22 14:58:56.889633 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-ef8153c6-d907-4eeb-a68b-adf2ef6f444d req-700bfea0-c750-4207-9017-bbbbd771fec2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182997 Sep 22 14:58:56.894549 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 58/122] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:57.039537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:57.040568 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:57.050210 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.051103 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.051726 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:57.053596 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.054298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.054961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:57.087366 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:57.088489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:57.099069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.101559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.102227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:57.103220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.103934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.104661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:57.316726 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:57.331597 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3a52d87c-cfcd-4eba-b5c9-fdc9efbd6d93 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.307106 Sep 22 14:58:57.332185 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 65/123] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:57 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:57.402041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:57.411572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:57.413010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:57.416298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b4c0e177-8896-41e5-96e9-ebe6dd974342 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.333728 Sep 22 14:58:57.416866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 59/124] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:57 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:58:57.718461 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:57.719107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:57.733967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:57.734581 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:57.739261 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.739801 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.740239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:57.740948 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.741398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.741817 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:57.745893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.746555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.747352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:57.748071 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:57.748531 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:57.748947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:58.189896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:58.201419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-deb2b477-27ac-48cb-a9b8-5c1b02923035 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.471307 Sep 22 14:58:58.209622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:57 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:58.238376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:58.249215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-12efe5c8-7368-42c2-b5e1-ad9c95bc26cb tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.535626 Sep 22 14:58:58.249791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 66/126] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:57 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:58.355969 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:58.356576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:58.363814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:58.365244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:58.365926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:58.366875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:58.367513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:58.368406 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:58.445737 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:58.446247 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:58.457811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:58.462634 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:58.463107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:58.465359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:58.465895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:58.467131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:58.663248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:58.677472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-52ef2f8b-f127-4d46-a677-25a1665e3222 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.324818 Sep 22 14:58:58.679721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 61/127] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:58 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:58:58.727412 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:58.740834 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:58.742666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:58.745073 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6fc98c53-b8f0-4e97-bd73-1ffd234025e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.306048 Sep 22 14:58:58.745732 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 67/128] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:58 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:58:58.910407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-c8dcb95b-eada-4130-bae5-5c184f08f06c req-a9eca6ef-bdaa-44c3-8e35-b34c6e558add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a790f1f1-dcd3-4803-9265-6802b65359bb", "name": "network-vif-plugged", "status": "completed", "tag": "2b1dceeb-de37-4a4e-a536-1fcee2278f4c"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:58:58.922836 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8dcb95b-eada-4130-bae5-5c184f08f06c req-a9eca6ef-bdaa-44c3-8e35-b34c6e558add service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:58.923756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8dcb95b-eada-4130-bae5-5c184f08f06c req-a9eca6ef-bdaa-44c3-8e35-b34c6e558add service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:58.924649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8dcb95b-eada-4130-bae5-5c184f08f06c req-a9eca6ef-bdaa-44c3-8e35-b34c6e558add service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:58.943384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-c8dcb95b-eada-4130-bae5-5c184f08f06c req-a9eca6ef-bdaa-44c3-8e35-b34c6e558add service nova] Creating event network-vif-plugged:2b1dceeb-de37-4a4e-a536-1fcee2278f4c for instance a790f1f1-dcd3-4803-9265-6802b65359bb on hv-cinder-84456 Sep 22 14:58:58.949949 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-c8dcb95b-eada-4130-bae5-5c184f08f06c req-a9eca6ef-bdaa-44c3-8e35-b34c6e558add service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043267 Sep 22 14:58:58.950684 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 62/129] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:58:59.225925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:59.226684 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:59.233951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.234490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.235447 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.236175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.237359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.237951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.277896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:59.279585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:59.288658 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.289660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.290595 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.291604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.292261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.292908 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.456662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:59.468560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fe3fcb0d-4074-4492-bfb3-7c5158714994 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.246724 Sep 22 14:58:59.469314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 68/130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:59 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:59.485753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:59.494383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ce6d13c1-668e-49a6-8ec9-407ba43b4f13 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.222085 Sep 22 14:58:59.495308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 63/131] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:59 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:58:59.703197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:59.703956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:59.710223 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.711104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.711582 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.712605 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.713617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.714588 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.774060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:58:59.774865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:58:59.788814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.789789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.790344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.791102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:58:59.793523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:58:59.794034 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:58:59.971794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:58:59.983109 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0363c67f-fe96-485e-811c-e4932c0c6333 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.284348 Sep 22 14:58:59.983962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 69/132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:58:59 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:00.029909 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:00.041379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:00.042943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:00.044056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b7d64247-af7d-4c87-b758-0ae46155cc08 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.276362 Sep 22 14:59:00.044606 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 64/133] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:58:59 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:59:00.492871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:00.493659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:00.500382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:00.501036 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:00.501476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:00.502175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:00.502630 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:00.503082 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:00.517475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:00.518108 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:00.525158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:00.525648 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:00.526250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:00.527185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:00.527761 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:00.528083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:00.754043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:00.762455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f0d97f60-9c69-4792-a8b8-fd5856e03d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.273432 Sep 22 14:59:00.763283 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 70/134] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:00 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:00.771951 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:00.786100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3cb3f3c6-d2d2-4ddf-b6b9-e22ded9734f9 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.272361 Sep 22 14:59:00.796388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:00 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:01.007279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:01.007882 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:01.018432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.018432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.018432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:01.018432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.018689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.018689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:01.070276 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:01.072130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:01.079578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.080545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.081309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:01.082360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.083544 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.084187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:01.231256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:01.248445 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-af4b5546-39d0-4efe-84bb-963d7452cd84 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.244619 Sep 22 14:59:01.250939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:01 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:01.330058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:01.343193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:01.344957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:01.346283 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-29142357-6f5c-45e8-a28d-494d4aaafbf2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.280806 Sep 22 14:59:01.365444 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 66/137] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:01 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:59:01.787766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:01.788590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:01.798252 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.798762 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.799214 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:01.799920 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.800376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.801571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:01.810780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:01.812595 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:01.828295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.829399 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.829988 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:01.830787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:01.831736 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:01.832874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:02.011543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:02.027444 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79a87dfd-48de-47f7-b6c2-7f6c19fa15bc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.243925 Sep 22 14:59:02.029487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 72/138] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:01 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:02.260840 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:02.272639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2b95c163-2101-470b-a030-9fe30dd1bfb2 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.464691 Sep 22 14:59:02.273536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 67/139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:01 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:02.277040 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:02.277904 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:02.285198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:02.285692 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:02.286129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:02.287392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:02.287847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:02.288271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:02.375799 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:02.377360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:02.393700 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:02.394255 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:02.394704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:02.395462 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:02.396439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:02.396869 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:02.524358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:02.530550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:02.533138 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2dc0d42c-20af-41ab-bbf3-8c7896365bc3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.262221 Sep 22 14:59:02.533717 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 73/140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:02 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:02.608474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:02.617880 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:02.619642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:02.620760 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-236b3028-1139-4c8b-9a81-f42b1dc92977 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.251533 Sep 22 14:59:02.621578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 68/141] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:02 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:59:03.052814 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:03.053434 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:03.059522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.060007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.060453 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.061140 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.061594 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.062022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.193833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:03.201860 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8b8e5d7e-51b1-4694-bb5f-ebdc7e45525e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.153229 Sep 22 14:59:03.202426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 74/142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:03 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:03.296005 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:03.296738 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:03.303786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.304421 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.304925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.306302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.307091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.307881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.453187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:03.463528 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-85425d8b-885b-48e7-a947-946d44cd8049 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.171383 Sep 22 14:59:03.466997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:03 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:03.567016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:03.567795 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:03.575106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.575689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.576193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.576981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.577505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.578003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.645985 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:03.646599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:03.653741 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.654497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.655195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.656082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:03.656949 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:03.657582 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:03.771700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:03.781929 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0488857a-8a2d-443e-a3de-99ab1c197ed3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.221348 Sep 22 14:59:03.783293 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 75/144] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:03 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:03.829656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:03.838531 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:03.840349 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:03.841462 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-95c7e919-99ef-4297-945d-ffe71e125d26 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.199521 Sep 22 14:59:03.842011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 70/145] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:03 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:59:04.225471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:04.225906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:04.231980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.232464 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.232895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.233590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.234042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.234465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.380454 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:04.389494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-82f34cad-5400-4a76-8e2d-c181d7e1d97f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.168000 Sep 22 14:59:04.390075 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 76/146] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:04 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:04.487343 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:04.488010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:04.494090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.494573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.495044 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.495740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.496201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.496659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.512560 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:04.646392 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:04.654443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-48b2fe9e-8a3e-4893-9e6c-868e710924c3 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1315 microversion: 2.1 time: 0.170841 Sep 22 14:59:04.655054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 71/147] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:04 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:04.807755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:04.808369 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:04.814292 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.814797 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.815242 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.815925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.816378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.816797 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.867342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:04.867957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:04.873879 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.874341 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.874795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.875501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:04.875954 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:04.876374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:04.985527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:04.994243 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4118b6a6-f054-49b6-a02b-2129f2e58a9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.190295 Sep 22 14:59:04.994758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 77/148] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:04 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:05.034598 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:05.043664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:05.045092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:05.046197 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1e10ff76-67b8-4751-a8c3-f947c38b58cd tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.183306 Sep 22 14:59:05.046804 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 72/149] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:04 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:59:05.413610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:05.415743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:05.422310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:05.422921 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:05.423431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:05.424198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:05.424820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:05.425278 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:05.552613 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-8c1eadfa-1886-4508-aae3-3ef842ffdd65 req-cb2e215c-dea4-46b1-8911-06e831a93775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5971c6-d2d8-4674-a079-4a4856e13fb6", "name": "network-vif-plugged", "status": "completed", "tag": "331bff57-f783-4dec-bed0-6844457674e1"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:05.564344 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:05.565982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-8c1eadfa-1886-4508-aae3-3ef842ffdd65 req-cb2e215c-dea4-46b1-8911-06e831a93775 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:05.566676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-8c1eadfa-1886-4508-aae3-3ef842ffdd65 req-cb2e215c-dea4-46b1-8911-06e831a93775 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:05.567535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-8c1eadfa-1886-4508-aae3-3ef842ffdd65 req-cb2e215c-dea4-46b1-8911-06e831a93775 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:05.574211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-12b47fb6-210d-4ab9-aa41-d3d814d42ffa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.164888 Sep 22 14:59:05.585246 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 78/150] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:05 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:05.596704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-8c1eadfa-1886-4508-aae3-3ef842ffdd65 req-cb2e215c-dea4-46b1-8911-06e831a93775 service nova] Creating event network-vif-plugged:331bff57-f783-4dec-bed0-6844457674e1 for instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 on hv-cinder-84456 Sep 22 14:59:05.602470 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-8c1eadfa-1886-4508-aae3-3ef842ffdd65 req-cb2e215c-dea4-46b1-8911-06e831a93775 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053567 Sep 22 14:59:05.603193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 73/151] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:05.681054 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:05.682213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:05.690297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:05.690861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:05.691350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:05.692840 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:05.693635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:05.694457 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:05.923255 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:05.938669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-de1c1df3-4904-4b20-9e4d-12660ad4c57e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1503 microversion: 2.1 time: 0.264261 Sep 22 14:59:05.939300 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 79/152] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:05 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:06.022138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:06.022992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:06.047898 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:06.048750 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:06.049380 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:06.050306 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:06.050782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:06.051443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:06.073818 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:06.074443 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:06.086175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:06.086944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:06.087727 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:06.088489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:06.089061 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:06.089857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:06.293478 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:06.300289 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:06.317723 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-21d15686-f102-4b3b-87f5-096138a4235c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.302470 Sep 22 14:59:06.329934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:06.330371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 74/153] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:06 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:06.330456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:06.330456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6da4e26e-bb58-4b85-b6e0-f2510deb538d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.257362 Sep 22 14:59:06.342843 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 80/154] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:06 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:59:06.604830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:06.606174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:06.626030 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:06.626953 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:06.627756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:06.628992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:06.629864 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:06.631156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:06.779366 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:06.788586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1f35da76-0047-4bfd-be18-ffdca74b618d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.194275 Sep 22 14:59:06.801707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 75/155] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:06 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:07.365071 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:07.366772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:07.375058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:07.375874 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:07.376540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:07.377623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:07.378250 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:07.378869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:07.381106 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:07.382526 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:07.390415 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:07.391197 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:07.391661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:07.392753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:07.393342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:07.394199 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:07.597024 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:07.605822 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:07.607705 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:07.608836 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e1f5f4bd-f474-4f33-8058-52e011ac8f07 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.248446 Sep 22 14:59:07.609562 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 81/156] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:07 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:59:07.629460 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-82954756-46cc-4bbd-bae0-0a663292a7a3 req-13b5894f-79ec-4453-8274-83c905e6d074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9275db0b-6903-400e-a766-1cb9effeedf1", "name": "network-vif-plugged", "status": "completed", "tag": "03ac6268-6935-466d-836e-bd953370c34d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:07.631630 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:07.640640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-178d6955-88b5-4eb0-91ce-b75c14fb5973 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.268516 Sep 22 14:59:07.640815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-82954756-46cc-4bbd-bae0-0a663292a7a3 req-13b5894f-79ec-4453-8274-83c905e6d074 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:07.641221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 76/157] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:07 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:07.641350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-82954756-46cc-4bbd-bae0-0a663292a7a3 req-13b5894f-79ec-4453-8274-83c905e6d074 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:07.641729 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-82954756-46cc-4bbd-bae0-0a663292a7a3 req-13b5894f-79ec-4453-8274-83c905e6d074 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:07.654491 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-82954756-46cc-4bbd-bae0-0a663292a7a3 req-13b5894f-79ec-4453-8274-83c905e6d074 service nova] Creating event network-vif-plugged:03ac6268-6935-466d-836e-bd953370c34d for instance 9275db0b-6903-400e-a766-1cb9effeedf1 on hv-cinder-84456 Sep 22 14:59:07.659616 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-82954756-46cc-4bbd-bae0-0a663292a7a3 req-13b5894f-79ec-4453-8274-83c905e6d074 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Sep 22 14:59:07.660375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 82/158] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 14:59:07.813125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:07.813747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:07.819685 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:07.820181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:07.820610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:07.821492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:07.821957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:07.822966 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:08.055972 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:08.065255 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b9ccab3b-029d-4918-be2f-ffe06aa77cb9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.256452 Sep 22 14:59:08.066310 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 77/159] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:07 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:08.635869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:08.637442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:08.644503 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:08.645218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:08.645874 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:08.646824 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:08.647822 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:08.648645 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:08.665252 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:08.667212 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:08.673762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:08.674713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:08.675954 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:08.677090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:08.677731 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:08.678333 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:08.956845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:08.969682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:08.971558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:08.992295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a2584070-458b-495d-9b1d-0eb232f39671 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.359362 Sep 22 14:59:08.994624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 83/160] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:08 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:59:09.021903 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:09.031958 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dc4f6a58-3234-4051-9f1b-0597c7d20bb6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1365 microversion: 2.1 time: 0.371095 Sep 22 14:59:09.048190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 78/161] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:08 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:09.090656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:09.091335 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:09.115374 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:09.117555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:09.118004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:09.120321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:09.125612 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:09.126623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:09.348943 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:09.358156 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-89f84b08-9544-4498-a713-abd743e9d173 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.273427 Sep 22 14:59:09.358835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 84/162] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:09 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:09.676045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-bf960ec3-2ad9-4fea-90f0-58939ad75808 req-460f0f37-c412-4bd9-a0b5-229b4dadcf4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45e6623-9952-42a0-b01e-85001ae14fd2", "name": "network-vif-plugged", "status": "completed", "tag": "ecbef20d-ee6a-4cae-8583-7ab49d776a37"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:09.704121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ba1af4-4cf3-4516-8bad-acd258d36e00"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:09.707132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:09.718537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:09.719072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:09.719507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:09.720210 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:09.720660 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:09.721078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:09.724892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-bf960ec3-2ad9-4fea-90f0-58939ad75808 req-460f0f37-c412-4bd9-a0b5-229b4dadcf4e service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:09.725536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-bf960ec3-2ad9-4fea-90f0-58939ad75808 req-460f0f37-c412-4bd9-a0b5-229b4dadcf4e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:09.726315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-bf960ec3-2ad9-4fea-90f0-58939ad75808 req-460f0f37-c412-4bd9-a0b5-229b4dadcf4e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:09.752812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-bf960ec3-2ad9-4fea-90f0-58939ad75808 req-460f0f37-c412-4bd9-a0b5-229b4dadcf4e service nova] Creating event network-vif-plugged:ecbef20d-ee6a-4cae-8583-7ab49d776a37 for instance c45e6623-9952-42a0-b01e-85001ae14fd2 on hv-cinder-84456 Sep 22 14:59:09.763547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-bf960ec3-2ad9-4fea-90f0-58939ad75808 req-460f0f37-c412-4bd9-a0b5-229b4dadcf4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090993 Sep 22 14:59:09.764153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 79/163] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:10.023322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:10.024629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:10.037921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.038887 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.039672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:10.041342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.042215 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.042984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:10.237095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:10.256855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:10.261187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:10.262524 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-163cbd50-580c-43e1-b383-0524eeac4da9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.244825 Sep 22 14:59:10.264431 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 80/164] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:10 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 14:59:10.271393 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:10.272205 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:10.280087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.280743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.281551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:10.282430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.283061 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.283711 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:10.479356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:10.488670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-592d7bc8-9670-422f-891c-357ecc4d7038 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1555 microversion: 2.1 time: 0.223061 Sep 22 14:59:10.491744 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 81/165] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:10 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:10.498894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:10.502581 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:10.511617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.512377 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.516996 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:10.517766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.518243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.518678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:10.739394 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:10.749628 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-66ca6c47-c18a-4e61-b778-9a9a46b7be72 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1321 microversion: 2.1 time: 0.256361 Sep 22 14:59:10.750411 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 82/166] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:10 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:10.760692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:10.761367 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:10.780653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.781149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.783285 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:10.784694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:10.785234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:10.785670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:11.154005 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bf84b2aa-b7d7-49cd-a5b9-88a1e22c0782 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.401004 Sep 22 14:59:11.156139 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 83/167] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 14:59:10 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-interface => generated 284 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:11.281956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fdec6739-6407-42fb-99fb-498c5816ce6e tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "POST /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.581919 Sep 22 14:59:11.285033 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 85/168] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 14:59:09 2022] POST /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb/os-volume_attachments => generated 194 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 14:59:11.298987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:11.299540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:11.302119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=99 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:11.310772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:11.311228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:11.311661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:11.312381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:11.312811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:11.313226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:11.646450 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:11.657283 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:11.668541 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:11.669938 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-67f2dfd2-67fb-4e16-b5b1-3243e1e78227 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.375542 Sep 22 14:59:11.670545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 84/169] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:11 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:59:11.774285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:11.775234 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:11.783361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:11.784000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:11.784446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:11.785155 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:11.785611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:11.786199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:12.524858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:12.540076 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f4e5888d-feb7-41a2-86b4-74aafb9b03df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1514 microversion: 2.1 time: 0.770729 Sep 22 14:59:12.557035 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 86/170] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:11 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1514 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:12.587684 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:12.592939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:12.605622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:12.606575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:12.607661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:12.609763 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:12.610455 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:12.612269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:12.680225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lazy-loading 'flavor' on Instance uuid 9275db0b-6903-400e-a766-1cb9effeedf1 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 14:59:12.704133 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:12.705770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:12.719306 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:12.720185 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:12.720946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:12.722247 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:12.724039 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:12.725165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:12.890235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-24a4406e-9b91-46cd-ac8e-1962070f01f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1/action" status: 200 len: 32 microversion: 2.1 time: 0.311920 Sep 22 14:59:12.891192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 85/171] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 14:59:12 2022] POST /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 14:59:12.906975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:12.907792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:12.916482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:12.917077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:12.918300 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:12.919512 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:12.920165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:12.920862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:13.007733 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:13.017790 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:13.021072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:13.026414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-43213059-f8b8-4865-befa-3d32b3723961 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.332155 Sep 22 14:59:13.027034 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 87/172] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:12 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:59:13.179660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:13.190198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7e241cc7-7eb4-49a5-99f2-fd9c8684f34c tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.292796 Sep 22 14:59:13.202758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 86/173] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:12 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:13.620114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-c56b8e50-4a8e-422c-b187-f8ec21899114 req-1dc2981a-ac3f-4745-bf55-44e0b50dc016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5971c6-d2d8-4674-a079-4a4856e13fb6", "tag": "331bff57-f783-4dec-bed0-6844457674e1"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:13.647140 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c56b8e50-4a8e-422c-b187-f8ec21899114 req-1dc2981a-ac3f-4745-bf55-44e0b50dc016 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:13.647597 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c56b8e50-4a8e-422c-b187-f8ec21899114 req-1dc2981a-ac3f-4745-bf55-44e0b50dc016 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:13.648021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c56b8e50-4a8e-422c-b187-f8ec21899114 req-1dc2981a-ac3f-4745-bf55-44e0b50dc016 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:13.679951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-c56b8e50-4a8e-422c-b187-f8ec21899114 req-1dc2981a-ac3f-4745-bf55-44e0b50dc016 service nova] Creating event network-changed:331bff57-f783-4dec-bed0-6844457674e1 for instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 on hv-cinder-84456 Sep 22 14:59:13.694420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-c56b8e50-4a8e-422c-b187-f8ec21899114 req-1dc2981a-ac3f-4745-bf55-44e0b50dc016 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086623 Sep 22 14:59:13.700292 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 88/174] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:14.055457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:14.056661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:14.067210 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:14.070442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:14.071264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:14.074409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:14.076282 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:14.078160 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:14.216083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:14.217167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:14.223467 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=89 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:14.225864 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:14.226776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:14.227726 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:14.230012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:14.237555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:14.238559 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:14.575737 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:14.580226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:14.600441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:14.602718 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:14.606227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:14.608424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-063367f2-733a-4be6-9edb-2907f337e1b2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.558559 Sep 22 14:59:14.609846 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 87/175] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:14 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:59:14.663211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cd54a91e-caa2-4631-98b1-e3f92395d7eb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.452208 Sep 22 14:59:14.678680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 89/176] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:14 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:15.668813 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:15.669405 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:15.677503 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:15.678015 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:15.678420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:15.679141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:15.679791 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:15.680210 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:15.702062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:15.703532 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:15.711384 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:15.712007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:15.713790 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:15.714925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:15.715603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:15.716240 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:15.742257 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:15.946325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:15.960721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:15.965118 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:15.966777 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-aa3b9bda-5143-4be7-9953-bfea991e0185 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1407 microversion: 2.20 time: 0.302329 Sep 22 14:59:15.968072 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 88/177] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:15 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:59:15.968480 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:15.981078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a9deb488-286e-4f81-b5d9-23275de4c95a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.280197 Sep 22 14:59:15.983127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 90/178] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:15 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:16.995656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:17.000634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:17.010771 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:17.012258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:17.013130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:17.014221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:17.015822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:17.017828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:17.020069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:17.021341 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:17.025200 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:17.025898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:17.027025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:17.028221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:17.029478 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:17.032833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:17.321666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:17.325257 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:17.331785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5483b76e-c058-49df-b0c3-fb348159deef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.324975 Sep 22 14:59:17.332373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 91/179] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:17 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:17.336048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:17.338104 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:17.339750 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e1a13ceb-4e4f-479e-9087-6c6688868b49 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1599 microversion: 2.20 time: 0.350729 Sep 22 14:59:17.340501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 89/180] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 14:59:16 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1599 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 14:59:17.372193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:17.372700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:17.378581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:17.379095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:17.379530 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:17.380233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:17.380682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:17.381102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:17.495993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-141e4a0a-2aa9-46fd-8ccd-f1c505abde72 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.132353 Sep 22 14:59:17.497182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 92/181] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 22 14:59:17 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 14:59:18.358759 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:18.360405 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:18.370425 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:18.370425 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:18.371029 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:18.371976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:18.372498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:18.373206 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:18.545473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:18.556990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6de10e19-c070-4f5a-ac81-2a81b7d6db30 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.203467 Sep 22 14:59:18.559242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 90/182] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:18 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:19.423353 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-e334088e-5d7e-45a0-8806-317b45158300 req-552f8ad6-be9f-4451-bd61-7942ddda53fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45e6623-9952-42a0-b01e-85001ae14fd2", "tag": "ecbef20d-ee6a-4cae-8583-7ab49d776a37"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:19.432733 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e334088e-5d7e-45a0-8806-317b45158300 req-552f8ad6-be9f-4451-bd61-7942ddda53fd service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:19.433304 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e334088e-5d7e-45a0-8806-317b45158300 req-552f8ad6-be9f-4451-bd61-7942ddda53fd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:19.433803 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e334088e-5d7e-45a0-8806-317b45158300 req-552f8ad6-be9f-4451-bd61-7942ddda53fd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:19.445755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-e334088e-5d7e-45a0-8806-317b45158300 req-552f8ad6-be9f-4451-bd61-7942ddda53fd service nova] Creating event network-changed:ecbef20d-ee6a-4cae-8583-7ab49d776a37 for instance c45e6623-9952-42a0-b01e-85001ae14fd2 on hv-cinder-84456 Sep 22 14:59:19.451685 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-e334088e-5d7e-45a0-8806-317b45158300 req-552f8ad6-be9f-4451-bd61-7942ddda53fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032499 Sep 22 14:59:19.452629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 93/183] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:19.582113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:19.582961 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:19.590666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:19.591627 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:19.592315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:19.593466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:19.593980 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:19.594458 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:19.748725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:19.762244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8a508496-e72e-4258-928e-e738e5fe9b92 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.184172 Sep 22 14:59:19.763125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 91/184] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:19 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:19.966050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-376521578", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "networks": [{"uuid": "1c9d098a-d890-4488-a4dc-8fa690de7dc6"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:20.048375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] validate_networks() for [('1c9d098a-d890-4488-a4dc-8fa690de7dc6', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:59:20.519744 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:59:20.520756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:59:20.521394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:59:20.521943 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:59:20.522502 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:59:20.534138 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:20.534614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:20.535145 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:20.535868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:20.536313 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:20.536727 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:20.560140 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Getting quotas for project 495d28624eac48069fdff279e2f1b001. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:59:20.564141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Getting quotas for user 6465d1250d2146b2be8d17a70b8bb929 and project 495d28624eac48069fdff279e2f1b001. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:59:20.576729 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:59:20.580115 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:59:20.648698 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8d85a031-b8ec-4e15-88f0-579b656ec05e tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687139 Sep 22 14:59:20.656449 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 94/185] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 14:59:20.662166 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2cc95052-f62c-456f-8d9b-a6a305254dfd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:20.663474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2cc95052-f62c-456f-8d9b-a6a305254dfd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:20.737828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2cc95052-f62c-456f-8d9b-a6a305254dfd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:20.746534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2cc95052-f62c-456f-8d9b-a6a305254dfd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1213 microversion: 2.1 time: 0.088196 Sep 22 14:59:20.760430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 92/186] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:20 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:20.787079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:20.787696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:20.798294 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:20.798934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:20.800262 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:20.801084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:20.801861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:20.802834 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:20.974773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:20.982264 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-40edd6f3-d139-4ef0-988b-5cc118e0190f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.199478 Sep 22 14:59:20.995171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 95/187] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:20 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:21.776985 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:21.781836 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:21.793795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:21.794032 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:21.794639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:21.795377 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:21.795821 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:21.796238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:21.868076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:21.876302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7196c06e-4ab5-4fa3-af22-91fb72b5a5f7 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1265 microversion: 2.1 time: 0.103726 Sep 22 14:59:21.876867 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 93/188] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:21 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:22.010065 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:22.010690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:22.017037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:22.017728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:22.018166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:22.019062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:22.019519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:22.019945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:22.168492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:22.176417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a8a91e5d-9967-4e1c-99e8-523a2c64de2e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.170130 Sep 22 14:59:22.176986 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 96/189] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:22 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:22.900607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:22.901341 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:22.907396 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:22.907876 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:22.908435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:22.909242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:22.909571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:22.909986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:22.977292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:22.986901 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-540cc73f-f3e2-40c4-aaff-8a0688679d75 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1273 microversion: 2.1 time: 0.090651 Sep 22 14:59:22.987493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 94/190] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:22 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:23.201174 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:23.202778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:23.209315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:23.209804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:23.210379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:23.211112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:23.211564 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:23.212837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:23.353966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:23.365375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ed185ba3-8f38-47f5-b507-1c5fb0e8985b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.169380 Sep 22 14:59:23.365949 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 97/191] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:23 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:24.012010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:24.013192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:24.020049 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:24.020715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:24.021312 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:24.022363 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:24.023035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:24.023835 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:24.132829 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:24.152552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1caddfa2-b0f1-4442-9404-ebda47a20167 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1273 microversion: 2.1 time: 0.144518 Sep 22 14:59:24.153154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 95/192] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:24 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:24.391126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:24.391823 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:24.401229 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:24.401719 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:24.402161 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:24.403107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:24.403560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:24.403985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:24.579270 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:24.593657 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e1533db6-3ed6-4f36-8444-f15be346f438 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.207170 Sep 22 14:59:24.595409 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 98/193] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:24 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:25.176496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:25.177103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:25.183945 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.184679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.185104 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:25.185961 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.186608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.187053 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:25.368745 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:25.377683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dec11747-7046-4b8a-af2b-04211237abda tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.204971 Sep 22 14:59:25.381000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 96/194] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:25 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:25.619766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:25.621025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:25.628080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.628748 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.629365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:25.630220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.630948 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.631518 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:25.637336 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:25.637598 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:25.644605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.645093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.645675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:25.646553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.647174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.647603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:25.693117 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Going to try to terminate instance {{(pid=120694) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 14:59:25.825036 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ed0ceb72-2d95-4a49-b6cd-11e96aabb286 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 204 len: 0 microversion: 2.1 time: 0.191866 Sep 22 14:59:25.826136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 97/195] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 14:59:25 2022] DELETE /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 14:59:25.836394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:25.840925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:25.841666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:25.849320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-655b45df-e068-4963-b68e-58078c5ae196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.233430 Sep 22 14:59:25.850157 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.850838 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 99/196] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:25 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:25.851088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.851592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:25.852339 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:25.852814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:25.853231 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:26.009459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-8d5c50d4-15f5-4a4f-ae27-8eb8af8f850d req-7584e718-7d55-4466-b359-ab904c53a8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1873d711-99e7-487c-97ca-36b253877b75", "tag": "acff79fe-3ffd-4613-8c26-35059d59d01f"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:26.022200 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8d5c50d4-15f5-4a4f-ae27-8eb8af8f850d req-7584e718-7d55-4466-b359-ab904c53a8a6 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:26.023563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8d5c50d4-15f5-4a4f-ae27-8eb8af8f850d req-7584e718-7d55-4466-b359-ab904c53a8a6 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:26.025102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8d5c50d4-15f5-4a4f-ae27-8eb8af8f850d req-7584e718-7d55-4466-b359-ab904c53a8a6 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:26.045143 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-8d5c50d4-15f5-4a4f-ae27-8eb8af8f850d req-7584e718-7d55-4466-b359-ab904c53a8a6 service nova] Creating event network-changed:acff79fe-3ffd-4613-8c26-35059d59d01f for instance 1873d711-99e7-487c-97ca-36b253877b75 on hv-cinder-84456 Sep 22 14:59:26.051091 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-8d5c50d4-15f5-4a4f-ae27-8eb8af8f850d req-7584e718-7d55-4466-b359-ab904c53a8a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045959 Sep 22 14:59:26.052068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 100/197] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:26.053742 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:26.063902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ede34a23-1d4b-42fd-bbd0-5a89f3b3882f tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1555 microversion: 2.1 time: 0.232852 Sep 22 14:59:26.064486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 98/198] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:25 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:26.402180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:26.403010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:26.409887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:26.410460 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:26.410996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:26.411775 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:26.412296 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:26.412812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:26.607403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:26.621137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-55f9224e-b9c0-44a0-86fc-5cb57dee680c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.223284 Sep 22 14:59:26.621870 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 101/199] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:26 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:26.874105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:26.874703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:26.880631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:26.881110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:26.881542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:26.882234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:26.882683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:26.883129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:27.026331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:27.034542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c6bc08e1-eec3-4132-89d9-e2340781c33e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.164166 Sep 22 14:59:27.035203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 99/200] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:26 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:27.090877 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:27.091494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:27.097997 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:27.098468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:27.099070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:27.099765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:27.100211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:27.100627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:27.237801 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:27.246386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d799c3cc-47c3-40f5-9add-87335f329021 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1555 microversion: 2.1 time: 0.162587 Sep 22 14:59:27.246994 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 102/201] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:27 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:27.644119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:27.644981 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:27.653568 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:27.653568 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:27.654169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:27.655088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:27.655560 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:27.656032 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:27.811667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:27.820235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-26dc98dc-9c31-438e-be14-8f57ff3bccf1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.179885 Sep 22 14:59:27.821637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 100/202] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:27 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:28.060867 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:28.062094 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:28.068190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:28.068676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:28.069107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:28.069975 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:28.070428 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:28.071803 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:28.217582 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:28.228875 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ce6cde3b-f536-46a4-85c1-319d8dc14938 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.171879 Sep 22 14:59:28.229487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 103/203] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:28 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:28.270563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:28.271162 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:28.278765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:28.279441 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:28.280110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:28.280781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:28.281233 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:28.281650 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:28.468150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:28.482424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-12046b3e-67eb-48f5-b89f-b1cf41c4a2fa tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1555 microversion: 2.1 time: 0.215940 Sep 22 14:59:28.483690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 101/204] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:28 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:28.846596 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:28.847363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:28.854111 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:28.854593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:28.855234 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:28.855905 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:28.856399 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:28.856813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:29.013334 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:29.021361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3868bdde-2337-4f52-957b-7bc9c7ead2f4 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.179529 Sep 22 14:59:29.021947 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 104/205] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:28 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:29.255042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:29.256577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:29.263446 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:29.263999 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:29.264560 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:29.265210 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:29.265668 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:29.266086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:29.473927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:29.506825 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:29.510304 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:29.513209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-68f8de36-2898-46dc-9f11-9b23e2ca2bc3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.262217 Sep 22 14:59:29.528593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:29.529647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 102/206] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:29 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:29.537954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:29.538417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:29.539344 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:29.539899 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:29.542620 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:29.603767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-45a298ef-b661-4397-9629-fdf9c241879b req-95a684aa-c687-42eb-902c-7fb847408bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a790f1f1-dcd3-4803-9265-6802b65359bb", "name": "network-vif-deleted", "tag": "2b1dceeb-de37-4a4e-a536-1fcee2278f4c"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:29.626390 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-45a298ef-b661-4397-9629-fdf9c241879b req-95a684aa-c687-42eb-902c-7fb847408bc8 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:29.626963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-45a298ef-b661-4397-9629-fdf9c241879b req-95a684aa-c687-42eb-902c-7fb847408bc8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:29.630055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-45a298ef-b661-4397-9629-fdf9c241879b req-95a684aa-c687-42eb-902c-7fb847408bc8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:29.645913 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:29.655587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b1d55043-98fa-408a-a929-76af9d8ec3d4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1513 microversion: 2.1 time: 0.153571 Sep 22 14:59:29.663583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 105/207] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:29 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:29.670105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-45a298ef-b661-4397-9629-fdf9c241879b req-95a684aa-c687-42eb-902c-7fb847408bc8 service nova] Creating event network-vif-deleted:2b1dceeb-de37-4a4e-a536-1fcee2278f4c for instance a790f1f1-dcd3-4803-9265-6802b65359bb on hv-cinder-84456 Sep 22 14:59:29.676253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-45a298ef-b661-4397-9629-fdf9c241879b req-95a684aa-c687-42eb-902c-7fb847408bc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081195 Sep 22 14:59:29.681352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 103/208] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 14:59:30.045910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:30.046689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:30.068644 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:30.070396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:30.071172 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:30.071971 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:30.072432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:30.072860 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:30.235716 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:30.243329 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6e0ced4e-5abc-4a06-84b2-344dfc80f793 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.201601 Sep 22 14:59:30.243898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 106/209] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:30 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:30.542546 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:30.543427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:30.550012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:30.550679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:30.551130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:30.552021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:30.552663 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:30.553382 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:30.575247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:30.683411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:30.685935 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:30.692960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:30.694563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:30.703645 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:30.704364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:30.704966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:30.705829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:30.706638 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:30.707034 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:30.737522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:30.744997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:30.748496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-63b07a35-9e76-4eff-b247-afd92fcaa95e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.210803 Sep 22 14:59:30.749081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 104/210] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:30 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:30.783792 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0addaa15e4c844a5acd84c3a5e3869ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3cda271ef3244f391962778ed33c351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:30.793944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4cffeb71-e445-4dae-9cb5-df7f502101f5 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 200 len: 1346 microversion: 2.1 time: 0.113515 Sep 22 14:59:30.794535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 107/211] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:30 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 1346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:31.269326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:31.270156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:31.279368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:31.280488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:31.281859 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:31.282856 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:31.283460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:31.284163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:31.448483 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:31.456714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b9efa15c-816f-4c2e-9cbc-4c2b2a534d57 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.194879 Sep 22 14:59:31.457308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 105/212] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:31 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:31.771228 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:31.771862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:31.778978 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:31.779517 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:31.780533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:31.781280 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:31.782271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:31.782755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:31.822816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:31.823520 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:31.830834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:31.831431 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:31.831974 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:31.832779 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:31.833510 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:31.834195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:31.854703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] HTTP exception thrown: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Request method failure captured: Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb HTTP/1.1 Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgK5BpDB2i9UzQqAydqpUOklDizDh9BzE7y22dwYDMdeX1Zh96SBylHkMyFjXrQ6QImj5ZzxfNAQ1JS7skqsz7lgGrz2W--lvUOrNopECEBBe__EIRx6KxTw6CdVboaEbaTHMk1gYduTyyxsmWKm9apRAe5xiMm1VRDndMAz2bh1JY Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 14:59:31.859862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d3cda271ef3244f391962778ed33c351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d3cda271ef3244f391962778ed33c351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 0addaa15e4c844a5acd84c3a5e3869ff Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:31.861402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'a790f1f1-dcd3-4803-9265-6802b65359bb'} Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:59:31.862217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:31.863730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:31.864921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Returning 404 to user: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:59:31.864921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6ceeb42b-dcfe-48b1-9ec5-e591154d6a51 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 404 len: 111 microversion: 2.1 time: 0.046659 Sep 22 14:59:31.864921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 106/213] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:31 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 14:59:31.939198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:31.947275 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-526f4ef9-c1e1-4fc2-a12b-0eb57f2cc0bd tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.179813 Sep 22 14:59:31.948353 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 108/214] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:31 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:32.007375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:32.009824 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:32.016014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:32.016596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:32.017102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:32.017871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:32.018397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:32.018923 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:32.031833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] HTTP exception thrown: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Request method failure captured: Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb/os-volume_attachments HTTP/1.1 Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgK5BpDB2i9UzQqAydqpUOklDizDh9BzE7y22dwYDMdeX1Zh96SBylHkMyFjXrQ6QImj5ZzxfNAQ1JS7skqsz7lgGrz2W--lvUOrNopECEBBe__EIRx6KxTw6CdVboaEbaTHMk1gYduTyyxsmWKm9apRAe5xiMm1VRDndMAz2bh1JY Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 14:59:32.033603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d3cda271ef3244f391962778ed33c351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d3cda271ef3244f391962778ed33c351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 0addaa15e4c844a5acd84c3a5e3869ff Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:32.035042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'server_id': 'a790f1f1-dcd3-4803-9265-6802b65359bb'} Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:59:32.040734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:32.042473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:32.043839 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Returning 404 to user: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:59:32.043839 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f088ea5e-0709-4b7c-9b83-68d45aaef0ce tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031730 Sep 22 14:59:32.043839 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 107/215] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 14:59:32 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:59:32.481748 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:32.482387 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:32.488474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:32.488965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:32.489398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:32.490085 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:32.490538 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:32.490984 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:32.508793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:32.634022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:32.642336 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7f854751-ec27-4d7d-a9cb-1a64aa846807 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.165908 Sep 22 14:59:32.651059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 109/216] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:32 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:32.973464 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:32.974002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:32.979941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:32.980414 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:32.980838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:32.981507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:32.981949 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:32.982362 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:33.114083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:33.122587 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c59fa5c5-5e4f-49de-a763-4ce5ff981bbc tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.153085 Sep 22 14:59:33.123191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 108/217] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:32 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:33.248467 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:33.249012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:33.255661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:33.256147 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:33.256615 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:33.257307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:33.257762 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:33.258184 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:33.271829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] HTTP exception thrown: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Request method failure captured: Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb HTTP/1.1 Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgK5BpDB2i9UzQqAydqpUOklDizDh9BzE7y22dwYDMdeX1Zh96SBylHkMyFjXrQ6QImj5ZzxfNAQ1JS7skqsz7lgGrz2W--lvUOrNopECEBBe__EIRx6KxTw6CdVboaEbaTHMk1gYduTyyxsmWKm9apRAe5xiMm1VRDndMAz2bh1JY Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 14:59:33.276519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d3cda271ef3244f391962778ed33c351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d3cda271ef3244f391962778ed33c351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 0addaa15e4c844a5acd84c3a5e3869ff Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.277829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'a790f1f1-dcd3-4803-9265-6802b65359bb'} Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:59:33.278459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.279514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.280541 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Returning 404 to user: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:59:33.280541 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-24873163-513a-4167-b00f-fa52059be51d tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 404 len: 111 microversion: 2.1 time: 0.033261 Sep 22 14:59:33.280541 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 110/218] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 14:59:33 2022] DELETE /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:59:33.286433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:33.287090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] [instance: a790f1f1-dcd3-4803-9265-6802b65359bb] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:33.293005 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:33.293479 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:33.293912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:33.294601 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:33.295085 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:33.295509 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:33.309204 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] HTTP exception thrown: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Request method failure captured: Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb HTTP/1.1 Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgK5BpDB2i9UzQqAydqpUOklDizDh9BzE7y22dwYDMdeX1Zh96SBylHkMyFjXrQ6QImj5ZzxfNAQ1JS7skqsz7lgGrz2W--lvUOrNopECEBBe__EIRx6KxTw6CdVboaEbaTHMk1gYduTyyxsmWKm9apRAe5xiMm1VRDndMAz2bh1JY Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 14:59:33.310707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d3cda271ef3244f391962778ed33c351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d3cda271ef3244f391962778ed33c351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d3cda271ef3244f391962778ed33c351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: d3cda271ef3244f391962778ed33c351 Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-DeleteServersTestJSON-783626259 Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 0addaa15e4c844a5acd84c3a5e3869ff Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-DeleteServersTestJSON-783626259-project Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.312225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'a790f1f1-dcd3-4803-9265-6802b65359bb'} Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:59:33.312942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. Sep 22 14:59:33.313962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 14:59:33.314912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] Returning 404 to user: Instance a790f1f1-dcd3-4803-9265-6802b65359bb could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:59:33.314912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-51440fc8-2911-42be-be66-3b9c1fb5dca4 tempest-DeleteServersTestJSON-783626259 tempest-DeleteServersTestJSON-783626259-project] 10.222.0.26 "GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb" status: 404 len: 111 microversion: 2.1 time: 0.029559 Sep 22 14:59:33.314912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 109/219] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:33 2022] GET /compute/v2.1/servers/a790f1f1-dcd3-4803-9265-6802b65359bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:59:33.512152 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-142675418", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:33.576755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] validate_networks() for None {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:59:33.666338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:33.667086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:33.673532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:33.674208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:33.674639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:33.675511 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:33.675967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:33.676384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:34.129347 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:34.138841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-83ce1f77-80e6-4331-a145-0267f5de1743 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.476921 Sep 22 14:59:34.139419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 110/220] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:33 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:34.150196 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:59:34.150744 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:59:34.151044 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:34.151474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:59:34.151654 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:34.152218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:59:34.152738 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:59:34.165201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:34.165971 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:34.166502 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:34.167648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:34.168354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:34.169003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:34.169461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:34.169963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:34.170391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:34.171122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:34.173743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:34.175518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:34.191577 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Getting quotas for project 412a2bb8e4e24a4db88f4ce940bf6a34. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:59:34.197003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Getting quotas for user 5b75e9af270641f8a96ed7a7be1e0c53 and project 412a2bb8e4e24a4db88f4ce940bf6a34. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:59:34.218913 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:59:34.221239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:59:34.275754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a7e43b0f-2f54-49c4-afea-8d036d866363 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767550 Sep 22 14:59:34.276440 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 111/221] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 14:59:34.288154 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1fc6911b-fa6b-42e5-92b3-37de909ae338 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:34.289132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1fc6911b-fa6b-42e5-92b3-37de909ae338 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:34.556527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1fc6911b-fa6b-42e5-92b3-37de909ae338 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:34.564471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1fc6911b-fa6b-42e5-92b3-37de909ae338 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1214 microversion: 2.1 time: 0.280722 Sep 22 14:59:34.565137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 112/222] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:34 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1214 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:34.677758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:34.687159 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-76cf31bb-d83d-4548-ad1c-7b615f7961f1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.540252 Sep 22 14:59:34.687739 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 111/223] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:34 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:35.163966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:35.165415 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:35.171962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:35.172456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:35.172886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:35.173595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:35.174076 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:35.174500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:35.428326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:35.439304 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-348056bf-7b10-4004-a5d4-6fa87144f377 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.279342 Sep 22 14:59:35.440398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 113/224] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:35 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:35.592146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:35.593808 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:35.600529 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:35.601514 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:35.602678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:35.603959 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:35.605059 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:35.606565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:35.712124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:35.713194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:35.721526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:35.722341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:35.723010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:35.723949 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:35.724687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:35.725495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:35.828331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:35.836724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4518f8a6-4f90-4c70-87e5-41b45364bc90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1266 microversion: 2.1 time: 0.249825 Sep 22 14:59:35.839743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 112/225] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:35 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:35.850247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-f76b688e-4b7b-4633-ae38-dbf28c0b7b46 req-1cd7336f-7620-4a2e-9d26-568f9b562b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1873d711-99e7-487c-97ca-36b253877b75", "name": "network-vif-plugged", "status": "completed", "tag": "acff79fe-3ffd-4613-8c26-35059d59d01f"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:35.870391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f76b688e-4b7b-4633-ae38-dbf28c0b7b46 req-1cd7336f-7620-4a2e-9d26-568f9b562b7a service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:35.871243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f76b688e-4b7b-4633-ae38-dbf28c0b7b46 req-1cd7336f-7620-4a2e-9d26-568f9b562b7a service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:35.871907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f76b688e-4b7b-4633-ae38-dbf28c0b7b46 req-1cd7336f-7620-4a2e-9d26-568f9b562b7a service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:35.884882 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-f76b688e-4b7b-4633-ae38-dbf28c0b7b46 req-1cd7336f-7620-4a2e-9d26-568f9b562b7a service nova] Creating event network-vif-plugged:acff79fe-3ffd-4613-8c26-35059d59d01f for instance 1873d711-99e7-487c-97ca-36b253877b75 on hv-cinder-84456 Sep 22 14:59:35.890714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-f76b688e-4b7b-4633-ae38-dbf28c0b7b46 req-1cd7336f-7620-4a2e-9d26-568f9b562b7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047538 Sep 22 14:59:35.892047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 113/226] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:35.982321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:35.990375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-55210951-6326-4f64-a0f9-80933360a146 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.282959 Sep 22 14:59:36.006016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 114/227] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:35 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:36.463878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:36.465043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:36.473269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:36.473754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:36.474345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:36.475439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:36.476040 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:36.476760 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:36.772138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:36.783650 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ec3c36d0-d1da-49de-be16-4e85e226c3f0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.324058 Sep 22 14:59:36.799418 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 114/228] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:36 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:36.869204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:36.869775 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:36.877008 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:36.877588 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:36.878339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:36.879263 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:36.879782 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:36.880416 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:36.959202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:36.967696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9e595352-20cb-4dc6-b0ac-404ffcb3f717 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1272 microversion: 2.1 time: 0.103594 Sep 22 14:59:36.968273 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 115/229] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:36 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:37.015715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:37.016475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:37.024427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:37.024890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:37.025322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:37.026095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:37.026549 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:37.026998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:37.225145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:37.235609 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2b2073c8-db4e-42cb-8b25-e1ed78123df5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.225008 Sep 22 14:59:37.236824 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 115/230] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:37 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:37.808406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:37.809425 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:37.816325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:37.816800 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:37.817509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:37.818085 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:37.818527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:37.819232 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:37.998498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:37.999110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:38.007926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:38.009654 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:38.010294 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:38.012369 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:38.029081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:38.029907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:38.068840 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:38.091668 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6e2ce354-c5c5-43d9-adb9-dd4f6bc80a6a tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1313 microversion: 2.1 time: 0.285914 Sep 22 14:59:38.108866 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 116/231] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:37 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:38.261082 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:38.262094 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:38.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:38.284707 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:38.285148 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:38.285860 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:38.295176 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:38.296012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:38.366602 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:38.382897 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d6406f6e-401f-4b9d-8fab-7f68a2352d75 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.390963 Sep 22 14:59:38.386413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 116/232] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:37 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:38.525758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:38.536298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d2bcb777-3966-4da7-9707-6bb73fbb3f7d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.279417 Sep 22 14:59:38.538089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 117/233] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:38 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:39.121292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:39.121916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:39.139264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:39.139998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:39.143294 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:39.147413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:39.148524 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:39.151020 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:39.411866 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:39.413955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:39.427307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:39.429526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:39.431112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:39.432731 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:39.434556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:39.435963 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:39.695240 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:39.706920 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5e5fb9c3-7fb0-48a7-a993-f2719931b855 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1496 microversion: 2.1 time: 0.587700 Sep 22 14:59:39.706920 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:39 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1496 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:39.717948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:39.720648 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:39.735334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:39.736365 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:39.738937 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:39.742039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:39.744815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:39.745346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:39.941526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:39.957362 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-50c1546b-5a5c-4579-9d47-e29c27ff23c8 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.549152 Sep 22 14:59:39.958865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 118/235] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:39 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:39.976130 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-19ca43f7-b1a5-451c-9b16-d50bd2539262 req-e8c98d2c-728c-4ed0-b3a5-828bc9e67974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be98a6e8-40dc-4353-a246-9ae9ea0970fd", "tag": "e0c6709f-acd2-4473-b42d-d585e4f378db"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:40.003735 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-19ca43f7-b1a5-451c-9b16-d50bd2539262 req-e8c98d2c-728c-4ed0-b3a5-828bc9e67974 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:40.004219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-19ca43f7-b1a5-451c-9b16-d50bd2539262 req-e8c98d2c-728c-4ed0-b3a5-828bc9e67974 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:40.004848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-19ca43f7-b1a5-451c-9b16-d50bd2539262 req-e8c98d2c-728c-4ed0-b3a5-828bc9e67974 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:40.026894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-19ca43f7-b1a5-451c-9b16-d50bd2539262 req-e8c98d2c-728c-4ed0-b3a5-828bc9e67974 service nova] Creating event network-changed:e0c6709f-acd2-4473-b42d-d585e4f378db for instance be98a6e8-40dc-4353-a246-9ae9ea0970fd on hv-cinder-84456 Sep 22 14:59:40.043773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-19ca43f7-b1a5-451c-9b16-d50bd2539262 req-e8c98d2c-728c-4ed0-b3a5-828bc9e67974 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080308 Sep 22 14:59:40.045903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 119/236] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:40.126792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:40.136687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e7f36c2b-243a-4a28-b9bf-2ad128b8d681 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.429834 Sep 22 14:59:40.139492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 118/237] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:39 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:40.297234 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:40.300555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:40.318791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:40.319296 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:40.319740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:40.320528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:40.320981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:40.321458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:40.384505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 14:59:40.549886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f00979a1-d2e7-40e3-b71c-911a803216a9 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 204 len: 0 microversion: 2.1 time: 0.260319 Sep 22 14:59:40.551344 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 120/238] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 14:59:40 2022] DELETE /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 14:59:40.560613 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:40.561756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:40.568101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:40.568766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:40.569373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:40.570634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:40.571277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:40.571847 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:40.783557 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:40.796700 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-940d5997-c513-4e99-ac2b-9615d8f1d533 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1502 microversion: 2.1 time: 0.240722 Sep 22 14:59:40.799039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 119/239] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:40 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:40.988340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:40.989083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:40.992258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:41.000609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:41.001469 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:41.001909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:41.002679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:41.003102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:41.003603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:41.163471 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:41.164656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:41.175342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:41.175964 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:41.176622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:41.177442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:41.178837 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:41.179579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:41.181238 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:41.194003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-60ad86c6-1817-46a8-aeb7-76ab22c1c9b5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.211571 Sep 22 14:59:41.195970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 121/240] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:40 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:41.343887 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:41.351518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-84ae566e-c488-4d08-a071-049c0e045f56 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.192531 Sep 22 14:59:41.352290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 120/241] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:41 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:41.823336 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:41.824106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:41.830303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:41.830803 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:41.831237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:41.831932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:41.832374 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:41.832958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:42.018749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:42.030191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1ac558a9-42d8-4132-acdd-e288270a7f30 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1502 microversion: 2.1 time: 0.210587 Sep 22 14:59:42.040218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 122/242] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:41 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:42.225409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:42.228202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:42.234697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:42.240403 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:42.241141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:42.241784 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:42.242767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:42.243429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:42.244066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:42.380850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:42.385847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:42.397642 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:42.399194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:42.400179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:42.401086 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:42.401540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:42.402324 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:42.405130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:42.413193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-68c84471-6afb-415c-87b1-ea585e9c6637 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.195050 Sep 22 14:59:42.414552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 121/243] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:42 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:42.552153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:42.560143 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7c1c6e5e-1d7d-4679-bd61-67764ed4c77d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.184817 Sep 22 14:59:42.568592 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 123/244] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:42 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:43.062722 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:43.064210 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:43.077772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:43.079081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:43.080031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:43.082646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:43.083700 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:43.084678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:43.229710 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:43.237630 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e5322f03-3634-4e75-b916-eef242a23659 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1502 microversion: 2.1 time: 0.184366 Sep 22 14:59:43.238216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 122/245] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:43 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:43.449542 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:43.450836 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:43.458973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:43.459741 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:43.460379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:43.461616 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:43.462072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:43.462493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:43.590371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:43.591491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:43.599143 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:43.599853 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:43.600561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:43.602349 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:43.602833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:43.604338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:43.660945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:43.669608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1040abae-a220-4751-a7ce-5e2017020dae tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.225702 Sep 22 14:59:43.670226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 124/246] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:43 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:43.967480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:43.969753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:43.977908 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-14952c1b-62af-46a4-8ec7-e7b21e994a38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.397585 Sep 22 14:59:43.978500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 123/247] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:43 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:44.262198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:44.262969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:44.265901 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:44.270193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:44.270688 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:44.271918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:44.272662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:44.273259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:44.274455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:44.568412 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=8 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:44.652894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:44.667750 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-85b56fbf-5b84-48f4-a054-1246cb36eef1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1502 microversion: 2.1 time: 0.409393 Sep 22 14:59:44.668785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 125/248] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:44 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:44.694833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:44.695831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:44.703626 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:44.704893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:44.705320 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:44.706196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:44.706863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:44.707250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:44.875990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:44.884496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bfead502-9f48-4546-9c8c-0b538e8dfaaa tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.194769 Sep 22 14:59:44.885679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 124/249] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:44 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:45.001847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:45.002587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:45.009774 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:45.010501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:45.010973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:45.011711 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:45.012350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:45.012768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:45.233737 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:45.243486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fa12e6ff-87eb-472b-ac7b-2bfa151455f3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.245715 Sep 22 14:59:45.259659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 126/250] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:44 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:45.691815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:45.692442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:45.698666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:45.699881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:45.700631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:45.701536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:45.701998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:45.702591 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:45.861509 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:45.873533 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-83789ad3-40f5-4a7f-a4ac-7929fe428d22 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1502 microversion: 2.1 time: 0.185427 Sep 22 14:59:45.881978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 125/251] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:45 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:45.912728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:45.914580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:45.921365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:45.921859 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:45.922297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:45.923079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:45.923534 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:45.923963 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:45.942867 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:46.080223 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:46.091061 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-88ae2df4-d569-4cc6-91ff-b714f51d0b83 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.183239 Sep 22 14:59:46.099782 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 127/252] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:45 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:46.270409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:46.271465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:46.282062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:46.284371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:46.285051 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:46.285805 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:46.286405 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:46.287191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:46.487796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:46.499738 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fe6377a0-4fec-47d7-aa90-2c0b41923e6f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.233791 Sep 22 14:59:46.500967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 126/253] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:46 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:46.779371 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0a2b7dbe-db75-4f1f-91c9-9c7981c5cce7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'create', calling method: .version_select at 0x7f77e66401f0>, body: {"keypair": {"name": "tempest-keypair-1555127664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcYzB0ARa6uo6Pq2Z2QpPUqv8lPhF2qKqCiKainJmNlTwRWBsZ/0jE52PEA5RhcAizlO6WwNJTBLtow/1ctA0OIUlj5AJmhonc04MdWO0/kCeocvPbpPCf2nF2MnA0ebg=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:46.795018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-0a2b7dbe-db75-4f1f-91c9-9c7981c5cce7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:59:46.798840 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-0a2b7dbe-db75-4f1f-91c9-9c7981c5cce7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for user da004a191bcd43b6a0865919813ec1a8 and project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:59:46.823737 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0a2b7dbe-db75-4f1f-91c9-9c7981c5cce7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186614 Sep 22 14:59:46.824341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 128/254] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 14:59:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:46.896885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:46.897507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:46.904939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:46.905439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:46.905875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:46.907055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:46.907687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:46.908115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:47.115537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:47.116063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:47.120156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:47.129964 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:47.130134 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f1cf68cf-049e-4247-ba5b-a1c897da4afe tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1502 microversion: 2.1 time: 0.236934 Sep 22 14:59:47.131112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:47.131284 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 127/255] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:46 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:47.132048 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:47.132966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:47.133560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:47.134122 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:47.335601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:47.345382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-da719487-5480-45b2-a107-2f9713e6ff5f tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.234465 Sep 22 14:59:47.347573 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 129/256] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:47 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:47.540269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:47.540908 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:47.550178 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:47.553209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:47.554222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:47.555594 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:47.556217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:47.557349 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:47.730802 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:47.739519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d6c342fa-04a8-4364-8549-992d3bf4682f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.206289 Sep 22 14:59:47.740373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 128/257] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:47 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:48.155372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:48.155995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:48.163416 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:48.164333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:48.164937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:48.165836 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:48.166505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:48.167146 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:48.323127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:48.334771 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-efa49efa-3293-4255-8e45-6d6c16aa4a34 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1502 microversion: 2.1 time: 0.183525 Sep 22 14:59:48.335432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 130/258] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:48 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:48.370507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:48.371048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:48.377008 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:48.377489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:48.377926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:48.378632 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:48.379115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:48.379539 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:48.403794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1446967834", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "029997dd-1780-49cc-a9d7-c81e1fc0dca4"}], "security_groups": [{"name": "tempest-securitygroup--1493553267"}], "key_name": "tempest-keypair-1555127664", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:48.551099 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] validate_networks() for [('029997dd-1780-49cc-a9d7-c81e1fc0dca4', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:59:48.556105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:48.564270 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3b9cdb2a-8ad8-4bb7-966b-3d48cfba2e89 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.198269 Sep 22 14:59:48.564946 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 129/259] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:48 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:48.766227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:48.774980 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:48.783318 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:48.783809 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:48.784248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:48.784951 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:48.785412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:48.785836 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.131864 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:49.147787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1e0cd48f-6112-4842-8a49-5bfdda7e6e73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.387763 Sep 22 14:59:49.168447 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 130/260] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:48 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:49.198618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:59:49.201214 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:59:49.201959 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:59:49.202390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:59:49.202869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:59:49.233949 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.234849 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.236882 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.237958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.239498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.242321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.267818 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:59:49.275300 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for user da004a191bcd43b6a0865919813ec1a8 and project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:59:49.293135 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:59:49.295884 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:59:49.365051 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-026a1abc-b4d6-4dca-9cd8-3d01b31a809b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.963508 Sep 22 14:59:49.365561 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 131/261] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:59:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 14:59:49.376816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:49.377366 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ea33146d-83ce-4a8d-b02f-36f9fc64aac2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:49.377967 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ea33146d-83ce-4a8d-b02f-36f9fc64aac2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:49.379889 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:49.391469 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.392405 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.393513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.395301 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.396231 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.399210 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.508466 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ea33146d-83ce-4a8d-b02f-36f9fc64aac2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:49.515587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ea33146d-83ce-4a8d-b02f-36f9fc64aac2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1238 microversion: 2.1 time: 0.142001 Sep 22 14:59:49.516165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 132/262] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:49 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1238 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:49.531905 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-7b4fc2c0-87c7-49ce-b08a-e1c163a90b3e req-3fe42982-76a4-44fa-8aef-6202d09e31c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1873d711-99e7-487c-97ca-36b253877b75", "name": "network-vif-deleted", "tag": "acff79fe-3ffd-4613-8c26-35059d59d01f"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:49.553198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-7b4fc2c0-87c7-49ce-b08a-e1c163a90b3e req-3fe42982-76a4-44fa-8aef-6202d09e31c5 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.553680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-7b4fc2c0-87c7-49ce-b08a-e1c163a90b3e req-3fe42982-76a4-44fa-8aef-6202d09e31c5 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.554117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-7b4fc2c0-87c7-49ce-b08a-e1c163a90b3e req-3fe42982-76a4-44fa-8aef-6202d09e31c5 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.561356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:49.573925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-299ea931-80bf-494d-b36d-656a4a0610e1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1460 microversion: 2.1 time: 0.203484 Sep 22 14:59:49.575052 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-7b4fc2c0-87c7-49ce-b08a-e1c163a90b3e req-3fe42982-76a4-44fa-8aef-6202d09e31c5 service nova] Creating event network-vif-deleted:acff79fe-3ffd-4613-8c26-35059d59d01f for instance 1873d711-99e7-487c-97ca-36b253877b75 on hv-cinder-84456 Sep 22 14:59:49.576218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 131/263] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:49 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1460 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:49.581841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-7b4fc2c0-87c7-49ce-b08a-e1c163a90b3e req-3fe42982-76a4-44fa-8aef-6202d09e31c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064488 Sep 22 14:59:49.582749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 133/264] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 14:59:49.596871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:49.597762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:49.606354 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.607737 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.608412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.610612 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.611715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.612332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.646023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-77cdc194-c4ba-4766-a510-d309c8edc23a req-fc8986d0-5463-42bf-bc11-284164acab6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be98a6e8-40dc-4353-a246-9ae9ea0970fd", "name": "network-vif-plugged", "status": "completed", "tag": "e0c6709f-acd2-4473-b42d-d585e4f378db"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:49.674438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77cdc194-c4ba-4766-a510-d309c8edc23a req-fc8986d0-5463-42bf-bc11-284164acab6c service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:49.676194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77cdc194-c4ba-4766-a510-d309c8edc23a req-fc8986d0-5463-42bf-bc11-284164acab6c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:49.676397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77cdc194-c4ba-4766-a510-d309c8edc23a req-fc8986d0-5463-42bf-bc11-284164acab6c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:49.692095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-77cdc194-c4ba-4766-a510-d309c8edc23a req-fc8986d0-5463-42bf-bc11-284164acab6c service nova] Creating event network-vif-plugged:e0c6709f-acd2-4473-b42d-d585e4f378db for instance be98a6e8-40dc-4353-a246-9ae9ea0970fd on hv-cinder-84456 Sep 22 14:59:49.697991 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-77cdc194-c4ba-4766-a510-d309c8edc23a req-fc8986d0-5463-42bf-bc11-284164acab6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060107 Sep 22 14:59:49.699185 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 134/265] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 14:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 14:59:49.825214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:49.834114 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a04ef2b5-249c-4e8d-8a64-bc66f98cc441 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.242699 Sep 22 14:59:49.835583 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 132/266] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:49 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:50.177968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:50.178807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:50.185649 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.186213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.186725 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:50.187516 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.188046 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.188562 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:50.337910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:50.346468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f3ac0c9e-6afe-4f50-ab75-0a1b774ba519 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.174306 Sep 22 14:59:50.347067 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 135/267] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:50 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:50.537467 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:50.538251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:50.545885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.546087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.546437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:50.547169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.547620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.548035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:50.597473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:50.598088 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:50.605385 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.606383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.607049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:50.608258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.608888 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.609755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:50.625062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:50.634275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1d9f7dd9-145e-4605-bcfb-cfb3600337ea tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1242 microversion: 2.1 time: 0.100633 Sep 22 14:59:50.635837 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 133/268] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:50 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:50.683029 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:50.691037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e8dc66d6-c4b1-473a-9c44-979592531e1f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1298 microversion: 2.1 time: 0.097351 Sep 22 14:59:50.691615 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 136/269] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:50 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:50.857556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:50.858332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:50.865177 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.867368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.867994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:50.868868 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:50.869473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:50.870056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:51.019028 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:51.027793 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e675a340-1610-4550-bce9-26204e795382 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.174252 Sep 22 14:59:51.028384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 134/270] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:50 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:51.370515 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:51.371213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:51.380972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:51.382079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:51.383437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:51.384739 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:51.385363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:51.385938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:51.526905 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:51.534471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0dd40ce6-29e8-4a69-94fe-10ffde568795 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.168556 Sep 22 14:59:51.535076 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 137/271] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:51 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:51.662360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:51.663093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:51.669662 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:51.670137 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:51.670565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:51.671286 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:51.671735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:51.672157 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:51.715607 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:51.716169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:51.722056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:51.722540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:51.723008 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:51.723713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:51.724165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:51.724590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:51.735835 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:51.743491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-12c3ae8d-0c49-4489-9044-e36b60ca2f04 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1242 microversion: 2.1 time: 0.085654 Sep 22 14:59:51.744096 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 135/272] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:51 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:51.786403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:51.794685 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e4922123-6ea0-450f-9dfd-953ec3757d7d tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1298 microversion: 2.1 time: 0.083981 Sep 22 14:59:51.795277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 138/273] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:51 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:52.056890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:52.057472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:52.065308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.066816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.067441 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.068454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.068900 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.069335 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.226171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:52.235016 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-45099d99-5c8a-4fc6-b0e3-4c55a58e7e04 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.182734 Sep 22 14:59:52.235726 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 136/274] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:52 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:52.558411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:52.559102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:52.565853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.566340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.566817 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.567517 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.568002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.568491 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.701475 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:52.709766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ad07598e-28e4-4b18-b03a-2605e63e800b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.155624 Sep 22 14:59:52.710385 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 139/275] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:52 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:52.765442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:52.766046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:52.772256 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.772737 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.773167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.773858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.774307 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.774758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.819490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:52.821060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:52.827478 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.827994 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.828434 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.829171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.829624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.830441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.836121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:52.844077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cdb80411-5446-4832-a683-5fa71d89ea97 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1234 microversion: 2.1 time: 0.082453 Sep 22 14:59:52.844647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 137/276] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:52 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:52.865904 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:52.866342 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:52.867435 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:52.867932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lazy-loading 'fault' on Instance uuid 1873d711-99e7-487c-97ca-36b253877b75 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 14:59:52.910487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:52.918569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9165a382-c990-43d2-bcf6-4ea21cda4489 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 200 len: 1303 microversion: 2.1 time: 0.104606 Sep 22 14:59:52.919364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 140/277] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:52 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:53.258325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:53.259270 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:53.276093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.276600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.277049 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.277771 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.278227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.278653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.488238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:53.501098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f943fa71-4e14-4c9c-a202-06f85df87685 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1314 microversion: 2.1 time: 0.246726 Sep 22 14:59:53.502859 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 138/278] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:53 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:53.735392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:53.736146 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:53.747202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.747417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.747808 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.748933 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.749048 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.749408 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.870578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:53.871437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:53.878071 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.878565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.879052 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.879886 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.880342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.880932 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.897187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:53.907123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-aee7012d-6d00-41a1-bcf8-8dfdbff304b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.175440 Sep 22 14:59:53.914774 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 141/279] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:53 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:53.943888 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:53.945491 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: 1873d711-99e7-487c-97ca-36b253877b75] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:53.950445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:53.952672 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.953167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.953824 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.954537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:53.955170 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:53.955832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:53.959442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4ae91ae3-47a3-4aab-986d-1646e45f6369 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1290 microversion: 2.1 time: 0.092900 Sep 22 14:59:53.960131 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 139/280] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:53 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:53.971619 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] HTTP exception thrown: Instance 1873d711-99e7-487c-97ca-36b253877b75 could not be found. Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Request method failure captured: Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 HTTP/1.1 Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHhGcrOL-SxfWd-RXlKdQJV2L9_7qdMmEDg8ZpjodaYLP9JFMCSNH8mx2PQNv01e5shZw0taCXTJbdv6YP2m7LDok2IHdUtTG8q0OHtv3mcVnW7GFTSz8NwN50ZxrP8eTDTwVUDBxe4_LlQNINpod7cLSKjOijEAJjwQ8PBZYrx8rNE Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 495d28624eac48069fdff279e2f1b001 Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesActionsTest-2030161344 Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 14:59:53.973318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/495d28624eac48069fdff279e2f1b001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_495d28624eac48069fdff279e2f1b001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/495d28624eac48069fdff279e2f1b001"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/495d28624eac48069fdff279e2f1b001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesActionsTest-2030161344 Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 495d28624eac48069fdff279e2f1b001 Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesActionsTest-2030161344 Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesActionsTest-2030161344-project Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 6465d1250d2146b2be8d17a70b8bb929 Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesActionsTest-2030161344-project Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 1873d711-99e7-487c-97ca-36b253877b75 could not be found. Sep 22 14:59:53.974611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '1873d711-99e7-487c-97ca-36b253877b75'} Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1873d711-99e7-487c-97ca-36b253877b75 could not be found. Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 14:59:53.975414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1873d711-99e7-487c-97ca-36b253877b75 could not be found. Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1873d711-99e7-487c-97ca-36b253877b75 could not be found. Sep 22 14:59:53.976610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 14:59:53.977651 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Returning 404 to user: Instance 1873d711-99e7-487c-97ca-36b253877b75 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 14:59:53.977651 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c6751c02-a82b-46a2-81a8-c74230da7013 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75" status: 404 len: 111 microversion: 2.1 time: 0.035707 Sep 22 14:59:53.977651 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 142/281] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:53 2022] GET /compute/v2.1/servers/1873d711-99e7-487c-97ca-36b253877b75 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 14:59:54.075776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-146334385", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "networks": [{"uuid": "1c9d098a-d890-4488-a4dc-8fa690de7dc6"}]}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 14:59:54.132934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] validate_networks() for [('1c9d098a-d890-4488-a4dc-8fa690de7dc6', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 14:59:54.478674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 14:59:54.479174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 14:59:54.479652 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 14:59:54.480062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 14:59:54.480499 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 14:59:54.490374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.490879 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.491468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.492497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.493493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.493923 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.512426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Getting quotas for project 495d28624eac48069fdff279e2f1b001. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 14:59:54.516344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Getting quotas for user 6465d1250d2146b2be8d17a70b8bb929 and project 495d28624eac48069fdff279e2f1b001. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 14:59:54.527847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:54.528229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 14:59:54.528681 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:54.530548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 14:59:54.535051 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.535613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.536285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.537080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.537610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.538105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.579610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-eb6d0771-a9cd-44ec-ac1b-f64adc1f7e60 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508162 Sep 22 14:59:54.580263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 140/282] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 14:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 14:59:54.591715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b6f73e80-57cb-44dd-867a-341fedbcb481 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:54.592353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b6f73e80-57cb-44dd-867a-341fedbcb481 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:54.659035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b6f73e80-57cb-44dd-867a-341fedbcb481 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:54.667987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b6f73e80-57cb-44dd-867a-341fedbcb481 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1213 microversion: 2.1 time: 0.080265 Sep 22 14:59:54.668797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 141/283] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:54 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:54.703668 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:54.711981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ee4e4554-13c4-4183-9242-7de52efd4dbd tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1464 microversion: 2.1 time: 0.188067 Sep 22 14:59:54.712534 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 143/284] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:54 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1464 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:54.762043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:54.762621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:54.770709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.771732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.772570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.774440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.775218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.775954 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.781182 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:54.803054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Going to try to terminate instance {{(pid=120694) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 14:59:54.885771 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4f74ae97-eb68-45d1-b819-6349dc9cf33e tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 204 len: 0 microversion: 2.1 time: 0.127560 Sep 22 14:59:54.886445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 142/285] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 14:59:54 2022] DELETE /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 14:59:54.894845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:54.895468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:54.902405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.902934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.903368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.904097 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.904506 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.904929 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.932178 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:54.932887 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:54.939476 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.940304 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.940708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:54.941637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:54.942254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:54.942869 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:55.104905 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:55.112715 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dc1ff2a2-191e-4c1d-a5a3-c6df4fe81835 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1470 microversion: 2.1 time: 0.221978 Sep 22 14:59:55.113626 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 144/286] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:54 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:55.118388 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:55.119220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:55.125285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:55.125954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:55.126397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:55.127202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:55.127659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:55.128245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:55.135411 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:55.143115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1cfbad1d-9374-4446-895a-0a5f0935e0ff tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.215253 Sep 22 14:59:55.143693 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 143/287] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:54 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:55.189445 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:55.197535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f9bd8030-c096-4ef9-9a86-e88939a91019 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1290 microversion: 2.1 time: 0.082932 Sep 22 14:59:55.198093 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 145/288] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:55 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:55.693599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:55.694125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:55.700669 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:55.701442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:55.701879 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:55.702571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:55.703050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:55.703473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:55.766262 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:55.773848 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-deafe77c-d2d0-4de5-8b29-9f5e8dfc3d7c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1217 microversion: 2.1 time: 0.084212 Sep 22 14:59:55.774410 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 144/289] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:55 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:56.135752 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:56.136372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:56.142875 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.143360 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.143803 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.144490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.144944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.145369 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.167181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:56.167789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:56.174010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.174490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.175295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.175998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.176448 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.176872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.331458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:56.340328 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9894d72d-3213-4dca-84e1-c2bb305f2e2a tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1470 microversion: 2.1 time: 0.208460 Sep 22 14:59:56.340906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 146/290] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:56 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:56.345608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:56.346250 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:56.349211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:56.353064 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.353783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.354341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.355180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.355740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.356383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.361086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f14cbf63-c523-4cdb-9c46-cc9cf9f405d8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.198082 Sep 22 14:59:56.362002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 145/291] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:56 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:56.423088 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:56.430712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a0aecf79-3fca-4e4d-b289-cfb38ce81000 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1290 microversion: 2.1 time: 0.088859 Sep 22 14:59:56.431295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 147/292] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:56 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:56.796229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:56.796968 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:56.802979 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.803540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.804100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.804889 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:56.805573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:56.806064 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:56.869069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:56.876770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-74caa301-1e1a-4bc8-a96d-dbaf4d4521ca tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1209 microversion: 2.1 time: 0.084324 Sep 22 14:59:56.877360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 146/293] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:56 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:57.363411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:57.364023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:57.373730 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.374498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.375081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.375784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.376233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.376660 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.384391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:57.385001 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:57.391276 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.391769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.392205 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.392905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.393359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.393786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.395335 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:57.566122 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:57.574171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b2e5a385-4f65-4e12-b600-aa1768afb0b2 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1470 microversion: 2.1 time: 0.214557 Sep 22 14:59:57.574769 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 148/294] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:57 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:57.579373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:57.579558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:57.579988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:57.587757 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9fcda2da-4822-44f9-9bda-96ef902e0471 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.207271 Sep 22 14:59:57.588630 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 147/295] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:57 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 14:59:57.592113 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.592729 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.593162 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.593917 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.594386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.594831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.657172 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:57.665659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8b5f0461-625d-4767-8724-a0fee062a538 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1290 microversion: 2.1 time: 0.089889 Sep 22 14:59:57.666218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 149/296] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:57 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:57.901102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:57.901614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:57.907593 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.908072 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.908523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.909182 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:57.909624 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:57.910039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:57.972214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:57.980322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f4bf61cb-7863-4d39-8b8d-99f4d6d99bd6 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1209 microversion: 2.1 time: 0.083595 Sep 22 14:59:57.980898 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 148/297] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:57 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:58.597895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:58.598505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:58.605150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:58.605632 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:58.606068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:58.606786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:58.607282 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:58.607658 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:58.612742 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:58.613442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:58.620108 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:58.620690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:58.621125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:58.621828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:58.622275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:58.622697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:58.795016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:58.803293 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-320758f1-96be-4757-8975-5a52577eae90 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1470 microversion: 2.1 time: 0.209703 Sep 22 14:59:58.804769 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 150/298] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:58 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:58.815014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:58.815014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:58.815193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:58.816041 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:58.816536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:58.816969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:58.817671 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:58.818128 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:58.818552 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:58.820871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8619181a-13ca-494d-920d-c8d47bf46d73 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.211761 Sep 22 14:59:58.821526 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 149/299] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:58 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:58.882547 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:58.890196 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dac4cdbf-b0b8-4456-a665-9e2f3ad7d588 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1298 microversion: 2.1 time: 0.084199 Sep 22 14:59:58.890756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 151/300] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:58 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:59.003119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:59.003648 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:59.009577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:59.010059 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:59.010497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:59.011233 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:59.011686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:59.012113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:59.074456 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 14:59:59.082094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-40e2f6c5-71ad-428f-b153-7627ddf41930 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1265 microversion: 2.1 time: 0.083010 Sep 22 14:59:59.082660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 150/301] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:58 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 14:59:59.829122 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:59.829735 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:59.831954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:59.832916 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=12 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:59:59.840335 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:59.840869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:59.841420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:59.842371 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:59.843108 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:59.843544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:59.850320 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 14:59:59.851558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 14:59:59.870307 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:59.873717 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:59.875148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 14:59:59.877727 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 14:59:59.878907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 14:59:59.880034 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:00.039437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:00.049117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-61542b78-5b82-43dd-9abc-06abe342132d tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1470 microversion: 2.1 time: 0.223882 Sep 22 15:00:00.050110 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 152/302] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:59 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:00.071593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:00.072279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:00.078981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:00.079469 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:00.079900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:00.080613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:00.081090 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:00.081473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:00.089219 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:00.097487 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6a0d2271-2915-4b91-8db9-cc2821cbaa9d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.255862 Sep 22 15:00:00.104838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 151/303] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 14:59:59 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:00.110637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:00.111687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:00.119286 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:00.119785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:00.120220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:00.120952 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:00.121388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:00.121811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:00.154319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:00.162649 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-29442f9c-ee57-4644-b760-be7d6641bd44 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1296 microversion: 2.1 time: 0.100292 Sep 22 15:00:00.163481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 153/304] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:00 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:00.190092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:00.198694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d744c082-294d-42a7-a715-5dc4f16a28f8 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1265 microversion: 2.1 time: 0.092424 Sep 22 15:00:00.199306 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 152/305] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:00 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:00.571557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-64ae6f6e-70da-490f-b448-daf46dfc65e1 req-00025a7f-6c19-430d-ba27-7d7b51853794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be98a6e8-40dc-4353-a246-9ae9ea0970fd", "name": "network-vif-deleted", "tag": "e0c6709f-acd2-4473-b42d-d585e4f378db"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:00.595000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-64ae6f6e-70da-490f-b448-daf46dfc65e1 req-00025a7f-6c19-430d-ba27-7d7b51853794 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:00.596903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-64ae6f6e-70da-490f-b448-daf46dfc65e1 req-00025a7f-6c19-430d-ba27-7d7b51853794 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:00.597499 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-64ae6f6e-70da-490f-b448-daf46dfc65e1 req-00025a7f-6c19-430d-ba27-7d7b51853794 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:00.623479 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-64ae6f6e-70da-490f-b448-daf46dfc65e1 req-00025a7f-6c19-430d-ba27-7d7b51853794 service nova] Creating event network-vif-deleted:e0c6709f-acd2-4473-b42d-d585e4f378db for instance be98a6e8-40dc-4353-a246-9ae9ea0970fd on hv-cinder-84456 Sep 22 15:00:00.629865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-64ae6f6e-70da-490f-b448-daf46dfc65e1 req-00025a7f-6c19-430d-ba27-7d7b51853794 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064129 Sep 22 15:00:00.631002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 154/306] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:00:01.079748 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:01.080872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:01.088010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.089147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.089767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.090780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.091236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.091658 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.123596 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:01.125037 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.125498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:01.125620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.125949 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.126679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lazy-loading 'fault' on Instance uuid be98a6e8-40dc-4353-a246-9ae9ea0970fd {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:00:01.134026 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.134515 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.135175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.136215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.136811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.137391 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.175425 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:01.185615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-184ca270-dd57-49fc-8325-73aac0c3ffe1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1304 microversion: 2.1 time: 0.113546 Sep 22 15:00:01.186189 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 153/307] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:01 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:01.191728 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:01.192537 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:01.200350 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.201237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.201823 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.202681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.203318 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.203743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.377789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:01.386829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2b4e67dd-a875-4937-9b01-a6fe79e4e58b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1520 microversion: 2.1 time: 0.268414 Sep 22 15:00:01.390956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 155/308] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:01 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:01.410165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:01.411057 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:01.413397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:01.420655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:01.422182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.423024 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.423690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.424730 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:01.425349 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:01.425930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:01.429660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7c41530c-3f6a-4e11-aded-e7ad1453fe1a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.242225 Sep 22 15:00:01.430479 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 154/309] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:01 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:01.496058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:01.506444 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-33215944-2c6e-49f3-9a90-3ef4b8452eb1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1271 microversion: 2.1 time: 0.114033 Sep 22 15:00:01.507631 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 156/310] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:01 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:02.210500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:02.211225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:02.217813 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.218679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.219138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.219841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.220482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.220913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.252436 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.252916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.253352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.253802 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lazy-loading 'fault' on Instance uuid be98a6e8-40dc-4353-a246-9ae9ea0970fd {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:00:02.295572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b75e9af270641f8a96ed7a7be1e0c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412a2bb8e4e24a4db88f4ce940bf6a34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:02.303143 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8cff164d-9253-44ab-b7da-2130905d3cb5 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 200 len: 1304 microversion: 2.1 time: 0.096991 Sep 22 15:00:02.304272 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 155/311] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:02 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:02.413366 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:02.414017 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:02.420535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.421018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.421458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.422155 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.422609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.423097 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.453158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:02.456158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:02.462707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.463332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.464247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.465023 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.465545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.466028 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.483691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:02.644331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:02.653021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-53d86112-6c3a-4545-a72c-23d8c9c75d84 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1500 microversion: 2.1 time: 0.244047 Sep 22 15:00:02.653596 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 157/312] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:02 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1500 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:02.673356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:02.674021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:02.679962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:02.683550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.684134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.684648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.685459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.685982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.686438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.688161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-95cbb627-b25a-4d4d-af4b-75192bb346a7 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.238709 Sep 22 15:00:02.688747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 156/313] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:02 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:02.704044 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:02.705445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:02.712558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.713045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.713487 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.714451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:02.714945 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:02.715376 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:02.911546 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:02.916041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:02.920531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-888a7fcb-0953-456c-b9fc-a9882b7ae513 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.265752 Sep 22 15:00:02.921649 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 158/314] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:02 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:02.926661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b3a700db-b511-4f22-b013-0ae4185460b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1515 microversion: 2.1 time: 0.236670 Sep 22 15:00:02.927457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 157/315] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:02 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:03.334811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:03.340159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] [instance: be98a6e8-40dc-4353-a246-9ae9ea0970fd] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:03.348426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:03.349271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:03.350371 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:03.352142 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:03.352867 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:03.353621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:03.374163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-1e7c26f3-3abe-4797-a3d1-90128f248a91 req-b3a3ccf3-363a-45d0-9761-57dffdc37622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da636b74-755d-4f4b-a681-b9d3241413af", "tag": "de2f3219-dc9c-4db5-9268-ea7773e7dc7a"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:03.398089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:03.399987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-1e7c26f3-3abe-4797-a3d1-90128f248a91 req-b3a3ccf3-363a-45d0-9761-57dffdc37622 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:03.400465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-1e7c26f3-3abe-4797-a3d1-90128f248a91 req-b3a3ccf3-363a-45d0-9761-57dffdc37622 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:03.400892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-1e7c26f3-3abe-4797-a3d1-90128f248a91 req-b3a3ccf3-363a-45d0-9761-57dffdc37622 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:03.412313 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] HTTP exception thrown: Instance be98a6e8-40dc-4353-a246-9ae9ea0970fd could not be found. Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Request method failure captured: Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd HTTP/1.1 Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHhTJ7rsrWW6fNpjo7MVz7eaCGBKFk2s8qkgc0_eEgZ1zgxkeiT_zWE38sVP3z8f82NB93Z8kvwrjNbV2w0Iuf4VU1tbFw7dlUG2yuqTNCjBf3kgBypyUo49MccWhmmmJ0NSkC5mYnvK-MiLyNjaQvCK2GsXT6XTRWek3z5xfdZXuVw Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 412a2bb8e4e24a4db88f4ce940bf6a34 Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-328566524 Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:00:03.418992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/412a2bb8e4e24a4db88f4ce940bf6a34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_412a2bb8e4e24a4db88f4ce940bf6a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/412a2bb8e4e24a4db88f4ce940bf6a34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/412a2bb8e4e24a4db88f4ce940bf6a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-328566524 Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 412a2bb8e4e24a4db88f4ce940bf6a34 Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-328566524 Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-328566524-project Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 5b75e9af270641f8a96ed7a7be1e0c53 Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-328566524-project Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance be98a6e8-40dc-4353-a246-9ae9ea0970fd could not be found. Sep 22 15:00:03.420676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'be98a6e8-40dc-4353-a246-9ae9ea0970fd'} Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be98a6e8-40dc-4353-a246-9ae9ea0970fd could not be found. Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:00:03.421333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be98a6e8-40dc-4353-a246-9ae9ea0970fd could not be found. Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be98a6e8-40dc-4353-a246-9ae9ea0970fd could not be found. Sep 22 15:00:03.422376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:03.430373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] Returning 404 to user: Instance be98a6e8-40dc-4353-a246-9ae9ea0970fd could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:00:03.430373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a4292f2b-f7ba-45ce-9a8d-aedb683fa2d1 tempest-VolumesNegativeTest-328566524 tempest-VolumesNegativeTest-328566524-project] 10.222.0.26 "GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd" status: 404 len: 111 microversion: 2.1 time: 0.092004 Sep 22 15:00:03.430373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 159/316] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:03 2022] GET /compute/v2.1/servers/be98a6e8-40dc-4353-a246-9ae9ea0970fd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:00:03.647993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-1e7c26f3-3abe-4797-a3d1-90128f248a91 req-b3a3ccf3-363a-45d0-9761-57dffdc37622 service nova] Creating event network-changed:de2f3219-dc9c-4db5-9268-ea7773e7dc7a for instance da636b74-755d-4f4b-a681-b9d3241413af on hv-cinder-84456 Sep 22 15:00:03.654160 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-1e7c26f3-3abe-4797-a3d1-90128f248a91 req-b3a3ccf3-363a-45d0-9761-57dffdc37622 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291039 Sep 22 15:00:03.655190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 158/317] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:00:03.714459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:03.715452 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:03.722583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:03.723419 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:03.724052 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:03.724959 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:03.726507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:03.727150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:03.947331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:03.948081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:03.956337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:03.958118 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:03.958641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:03.961596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:03.962965 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:03.963693 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:03.964534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:03.968741 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-aec280af-1fa1-49ff-a943-2fb91755ea0e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.259374 Sep 22 15:00:03.970219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 160/318] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:03 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:04.147003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:04.156481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f144caa6-4f25-434d-94fe-ed074e6f4820 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.214600 Sep 22 15:00:04.171214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 159/319] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:03 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:04.395159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:04.398155 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:04.407001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:04.407564 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:04.408175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:04.410276 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:04.410756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:04.411188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:04.442055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lazy-loading 'flavor' on Instance uuid 4cdb9447-4895-42dd-bb76-06ef6acb90fe {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:00:04.562823 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e70f410c-4893-4b50-ab4a-50aa57e94187 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe/action" status: 200 len: 32 microversion: 2.1 time: 0.171852 Sep 22 15:00:04.563432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 161/320] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:00:04 2022] POST /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 15:00:04.573956 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:04.574548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:04.576672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:04.582319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:04.582782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:04.583224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:04.583922 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:04.584374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:04.584799 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:04.666826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=8 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:04.722520 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:04.731401 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bc1f08bf-712b-4ee1-be22-d8a98028e57b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.162206 Sep 22 15:00:04.732039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 160/321] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:04 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:04.997611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:04.998417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:05.008895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:05.009387 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:05.009822 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:05.010526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:05.011009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:05.011434 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:05.169661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:05.177779 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-36ca7ee9-05a2-46b4-b5ab-df1bf786e710 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.184779 Sep 22 15:00:05.178352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 162/322] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:04 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:05.191297 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:05.192146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:05.199185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:05.199667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:05.200108 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:05.200816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:05.201269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:05.201722 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:05.342828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:05.351573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-749822dd-edde-4c48-aec9-48930413003c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.174776 Sep 22 15:00:05.352185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 161/323] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:05 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:05.682498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-5becc372-6805-4fda-88b7-ce88872f041a req-5b79de57-abfa-42e5-b411-d9b54de2d608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea87b94-a17c-4cc6-b9f0-2113981000f9", "tag": "b27f208f-6d3b-421a-8a4d-858c6688a093"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:05.692129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5becc372-6805-4fda-88b7-ce88872f041a req-5b79de57-abfa-42e5-b411-d9b54de2d608 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:05.692679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5becc372-6805-4fda-88b7-ce88872f041a req-5b79de57-abfa-42e5-b411-d9b54de2d608 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:05.693183 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5becc372-6805-4fda-88b7-ce88872f041a req-5b79de57-abfa-42e5-b411-d9b54de2d608 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:05.705108 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-5becc372-6805-4fda-88b7-ce88872f041a req-5b79de57-abfa-42e5-b411-d9b54de2d608 service nova] Creating event network-changed:b27f208f-6d3b-421a-8a4d-858c6688a093 for instance dea87b94-a17c-4cc6-b9f0-2113981000f9 on hv-cinder-84456 Sep 22 15:00:05.710679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-5becc372-6805-4fda-88b7-ce88872f041a req-5b79de57-abfa-42e5-b411-d9b54de2d608 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031531 Sep 22 15:00:05.711525 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 163/324] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:05.754534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:05.755430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:05.761850 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:05.762599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:05.763146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:05.763848 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:05.764318 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:05.764750 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:05.909398 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:05.918363 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-67c89420-a510-497b-adea-e31f479c6bca tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.167477 Sep 22 15:00:05.919227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 162/325] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:05 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:06.202303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:06.203148 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:06.209397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:06.210068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:06.210576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:06.211386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:06.211914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:06.212416 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:06.375947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:06.376558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:06.376896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:06.384567 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:06.385357 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:06.385792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:06.386542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:06.386940 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0dd89c7c-e583-4076-9de5-3fc188a26435 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.189235 Sep 22 15:00:06.387072 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:06.387430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:06.387531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 164/326] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:06 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:06.566941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:06.580144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-575e9507-d2f3-402b-bb17-71695edc4890 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.208078 Sep 22 15:00:06.581039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 163/327] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:06 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:06.941529 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:06.942094 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:06.948793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:06.949846 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:06.950581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:06.951376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:06.951842 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:06.952267 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:06.957563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:07.103307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:07.112480 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e7581c8c-0361-4c7f-b7bb-05730befc452 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.174964 Sep 22 15:00:07.113262 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 165/328] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:06 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:07.409468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:07.410250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:07.416909 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:07.417401 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:07.417837 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:07.418538 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:07.419021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:07.419449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:07.550396 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:07.558602 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-43c5831f-b002-45cf-a276-72dbddae021b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.152942 Sep 22 15:00:07.559203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 164/329] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:07 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:07.608395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:07.609134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:07.616269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:07.616764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:07.617211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:07.617928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:07.618390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:07.618841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:07.752581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:07.761399 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5a7e70c2-5eaf-41f0-98d4-310db05ed170 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.157076 Sep 22 15:00:07.761991 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 166/330] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:07 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:08.137310 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:08.137927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:08.143756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:08.144242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:08.144679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:08.145371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:08.145831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:08.146251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:08.276423 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:08.284127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2d509fbc-1e62-414a-a013-b9f4dfa64dd3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.150745 Sep 22 15:00:08.284692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 165/331] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:08 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:08.581339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:08.582007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:08.588341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:08.589195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:08.589626 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:08.590490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:08.591124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:08.591548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:08.747678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:08.757479 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f2c499e0-c39a-46d9-8103-ccda262b315d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.179073 Sep 22 15:00:08.758343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 167/332] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:08 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:08.788609 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:08.789374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:08.796087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:08.802378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:08.803031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:08.803990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:08.804773 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:08.805375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:08.920558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-5a43b109-4bea-4f22-a558-ddb7a3d7a7ec req-1570853c-556d-4089-9962-f4a34c56a220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea87b94-a17c-4cc6-b9f0-2113981000f9", "name": "network-vif-plugged", "status": "completed", "tag": "b27f208f-6d3b-421a-8a4d-858c6688a093"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:08.940957 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5a43b109-4bea-4f22-a558-ddb7a3d7a7ec req-1570853c-556d-4089-9962-f4a34c56a220 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:08.942011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5a43b109-4bea-4f22-a558-ddb7a3d7a7ec req-1570853c-556d-4089-9962-f4a34c56a220 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:08.942983 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-5a43b109-4bea-4f22-a558-ddb7a3d7a7ec req-1570853c-556d-4089-9962-f4a34c56a220 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:08.956742 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:08.963484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-5a43b109-4bea-4f22-a558-ddb7a3d7a7ec req-1570853c-556d-4089-9962-f4a34c56a220 service nova] Creating event network-vif-plugged:b27f208f-6d3b-421a-8a4d-858c6688a093 for instance dea87b94-a17c-4cc6-b9f0-2113981000f9 on hv-cinder-84456 Sep 22 15:00:08.966927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5c910954-6e89-4ab3-9375-51faaac6d4bd tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.182743 Sep 22 15:00:08.967456 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 166/333] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:08 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:08.972503 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-5a43b109-4bea-4f22-a558-ddb7a3d7a7ec req-1570853c-556d-4089-9962-f4a34c56a220 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056554 Sep 22 15:00:08.973810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 168/334] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:00:09.317734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:09.318498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:09.326770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:09.327572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:09.328227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:09.329590 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:09.331181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:09.331619 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:09.487048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:09.495489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-53c87e1d-1e88-4fb0-9e96-1a9a3792b7f8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.185749 Sep 22 15:00:09.496078 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 167/335] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:09 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:09.782666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:09.783592 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:09.790266 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:09.790835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:09.791217 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:09.791936 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:09.792389 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:09.792813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:09.991727 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:09.992446 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:09.998500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:09.999103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:09.999605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:10.000319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:10.000770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:10.001195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:10.059786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:10.067625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bee4ee29-ee19-4447-8f3b-51a1a76b4486 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1364 microversion: 2.1 time: 0.289625 Sep 22 15:00:10.068206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 169/336] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:09 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:10.248491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:10.256192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6adc1820-6145-447d-8c1a-b3230badea03 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.269040 Sep 22 15:00:10.256847 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 168/337] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:09 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:10.526099 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:10.526820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:10.533079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:10.533627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:10.534132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:10.534968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:10.535526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:10.536039 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:10.679241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:10.688639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-07beff75-82b3-4fa2-995b-f670aa7647c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.167093 Sep 22 15:00:10.689350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 170/338] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:10 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:10.988312 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-16d9f5a8-f967-46f6-87c0-efaedde01723 req-81651ad0-da7d-478a-af8b-6292cca6fd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da636b74-755d-4f4b-a681-b9d3241413af", "name": "network-vif-plugged", "status": "completed", "tag": "de2f3219-dc9c-4db5-9268-ea7773e7dc7a"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:10.999794 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-16d9f5a8-f967-46f6-87c0-efaedde01723 req-81651ad0-da7d-478a-af8b-6292cca6fd27 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.001686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-16d9f5a8-f967-46f6-87c0-efaedde01723 req-81651ad0-da7d-478a-af8b-6292cca6fd27 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.002127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-16d9f5a8-f967-46f6-87c0-efaedde01723 req-81651ad0-da7d-478a-af8b-6292cca6fd27 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.013896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-16d9f5a8-f967-46f6-87c0-efaedde01723 req-81651ad0-da7d-478a-af8b-6292cca6fd27 service nova] Creating event network-vif-plugged:de2f3219-dc9c-4db5-9268-ea7773e7dc7a for instance da636b74-755d-4f4b-a681-b9d3241413af on hv-cinder-84456 Sep 22 15:00:11.019866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-16d9f5a8-f967-46f6-87c0-efaedde01723 req-81651ad0-da7d-478a-af8b-6292cca6fd27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035085 Sep 22 15:00:11.020574 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 169/339] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:11.092119 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:11.092728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:11.099853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.100910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.101345 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.102038 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.102484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.102927 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.241166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:11.248975 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ac7800ac-0f70-446a-8b97-dfa295be337e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1550 microversion: 2.1 time: 0.161086 Sep 22 15:00:11.249544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 171/340] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:11 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:11.273171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:11.273840 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:11.279028 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:11.279663 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:11.280204 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.280690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.281122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.282013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.282459 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.282918 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.285544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.286011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.286441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.287159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.287747 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.288682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.385694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cfe74dfb-a6d8-4d6e-aa24-ff3b9f09e954 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117216 Sep 22 15:00:11.386292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 170/341] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 15:00:11 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:11.448678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:11.456320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2da9713d-2f7b-4b79-9469-62e61bc0996b tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.181150 Sep 22 15:00:11.456875 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 172/342] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:11 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:11.713657 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:11.714551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:11.720700 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.721180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.721611 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.722313 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:11.722789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:11.723214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:11.856911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:11.864940 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7a84d6ca-748a-43a9-b530-e2686ed88440 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.155218 Sep 22 15:00:11.865606 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 171/343] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:11 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:11.963510 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1048559413", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "networks": [{"uuid": "27e826c9-62b2-4387-99ab-396d01e4e4f6"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:12.019118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] validate_networks() for [('27e826c9-62b2-4387-99ab-396d01e4e4f6', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:00:12.340168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-598cafd9-347a-4df3-bd9e-1e23f7ac9abc req-e71d4254-ed51-4989-8252-1590f74929e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea87b94-a17c-4cc6-b9f0-2113981000f9", "tag": "b27f208f-6d3b-421a-8a4d-858c6688a093"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:12.351169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-598cafd9-347a-4df3-bd9e-1e23f7ac9abc req-e71d4254-ed51-4989-8252-1590f74929e5 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:12.351642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-598cafd9-347a-4df3-bd9e-1e23f7ac9abc req-e71d4254-ed51-4989-8252-1590f74929e5 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:12.352321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-598cafd9-347a-4df3-bd9e-1e23f7ac9abc req-e71d4254-ed51-4989-8252-1590f74929e5 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:12.365073 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-598cafd9-347a-4df3-bd9e-1e23f7ac9abc req-e71d4254-ed51-4989-8252-1590f74929e5 service nova] Creating event network-changed:b27f208f-6d3b-421a-8a4d-858c6688a093 for instance dea87b94-a17c-4cc6-b9f0-2113981000f9 on hv-cinder-84456 Sep 22 15:00:12.370830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-598cafd9-347a-4df3-bd9e-1e23f7ac9abc req-e71d4254-ed51-4989-8252-1590f74929e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034486 Sep 22 15:00:12.371704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 172/344] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:00:12.383610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:00:12.384075 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:00:12.384485 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:00:12.384885 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:00:12.385286 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:00:12.394334 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:12.394868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:12.395297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:12.396011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:12.396456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:12.396872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:12.414120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Getting quotas for project 26875c24ce944501a6b23188c784d9f5. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:00:12.418320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Getting quotas for user 8463811a630e4b90b1cd96e4dec020a2 and project 26875c24ce944501a6b23188c784d9f5. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:00:12.430690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:00:12.433446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:00:12.480381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:12.481082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:12.487449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:12.488134 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:12.488751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:12.489682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:12.490345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:12.491035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:12.497458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-acb67204-983b-4b59-bafb-83b94d107652 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536977 Sep 22 15:00:12.498793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 173/345] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:00:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:00:12.512816 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-10c0b3b5-79a2-4eec-a1f2-b709dd5f93c2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:12.513815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-10c0b3b5-79a2-4eec-a1f2-b709dd5f93c2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:12.593874 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-10c0b3b5-79a2-4eec-a1f2-b709dd5f93c2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:12.604473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-10c0b3b5-79a2-4eec-a1f2-b709dd5f93c2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1219 microversion: 2.1 time: 0.096445 Sep 22 15:00:12.625465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 174/346] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:12 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:12.658370 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:12.668188 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1be6cce7-658e-419a-8630-3aaf90075e5c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1313 microversion: 2.1 time: 0.191949 Sep 22 15:00:12.668911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 173/347] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:12 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:12.890627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:12.891909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:12.899416 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:12.900015 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:12.900515 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:12.901580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:12.902081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:12.902574 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:13.041778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:13.050943 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e3e0f847-3926-4c90-8fad-27807fbed8b9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.165777 Sep 22 15:00:13.051506 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 175/348] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:12 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:13.629514 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:13.630135 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:13.636808 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:13.637288 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:13.637721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:13.638408 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:13.638892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:13.639322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:13.692091 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:13.692700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:13.699451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:13.699911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:13.700034 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:13.700360 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:13.701066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:13.701517 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:13.701944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:13.707884 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5c60ac51-0955-4156-96ba-3bf3c16efc7a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1271 microversion: 2.1 time: 0.082345 Sep 22 15:00:13.708445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 174/349] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:13 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:13.837625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:13.845625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-da5f9220-0562-4a0d-8db6-b63fbebbbe6c tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1496 microversion: 2.1 time: 0.157506 Sep 22 15:00:13.846166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 176/350] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:13 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:14.075551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:14.076183 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:14.082070 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.082601 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.083096 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.083801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.084253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.084751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.104540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:14.235088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:14.255900 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bb081fb9-cb9a-4228-bcb4-19b319e2b8ce tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.185142 Sep 22 15:00:14.257228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 175/351] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:14 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:14.365354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:14.366390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:14.372392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.372894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.373330 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.374051 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.374509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.374962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.404409 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:00:14.482625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-53446895-e65c-41d1-8dd4-818ee66b92b0 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "DELETE /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 204 len: 0 microversion: 2.1 time: 0.120130 Sep 22 15:00:14.483358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 177/352] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:00:14 2022] DELETE /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:00:14.491999 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:14.492614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:14.499110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.499922 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.500351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.501261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.501796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.502223 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.633946 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:14.642669 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a3ea9105-16fd-4fde-8784-b17cace3a223 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1502 microversion: 2.1 time: 0.154746 Sep 22 15:00:14.643176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 176/353] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:14 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:14.731785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:14.732516 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:14.738896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.739455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.739811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.740499 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:14.741564 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:14.741988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:14.875416 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:14.883216 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4a96b0e8-365f-4ef4-9e96-184a7dccc208 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.155694 Sep 22 15:00:14.883794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 178/354] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:14 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:15.280261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:15.280876 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:15.287012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.288126 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.288567 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:15.289266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.289752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.290175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:15.417337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:15.425233 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f2f1ef6f-e184-413c-8430-786b706b9f98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.148832 Sep 22 15:00:15.425825 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 177/355] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:15 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:15.665837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:15.666377 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:15.672367 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.672848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.673282 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:15.674004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.674463 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.674919 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:15.807556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:15.813904 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:15.815076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:15.816190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7dade296-0fcf-4615-adb1-155e69fcf1b1 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1502 microversion: 2.1 time: 0.154408 Sep 22 15:00:15.816977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 179/356] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:15 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:15.823378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.823945 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.824460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:15.825361 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.825791 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.826382 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:15.851041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b0ce6ee6-e2e4-4316-b1f2-da6736ee7f62 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/ips" status: 200 len: 152 microversion: 2.20 time: 0.040984 Sep 22 15:00:15.852165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 178/357] 10.222.0.26 () {60 vars in 1289 bytes} [Thu Sep 22 15:00:15 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 15:00:15.906548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:15.907435 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:15.913558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.914043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.914680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:15.915412 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:15.915918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:15.916568 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:16.056620 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:16.065699 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-af933620-381c-4b26-ac2b-dc98fe8505e8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.162930 Sep 22 15:00:16.066310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 180/358] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:15 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:16.431091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:16.431524 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:16.437912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:16.438321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:16.438786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:16.439501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:16.439992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:16.440416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:16.449445 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:16.450511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:16.457126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:16.457945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:16.458490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:16.459363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:16.459990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:16.460787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:16.469292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d64e63c9-d471-4b4f-958d-fab177e4c438 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/ips" status: 200 len: 150 microversion: 2.1 time: 0.042888 Sep 22 15:00:16.470060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 179/359] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:00:16 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:16.632145 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:16.642365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-044be102-b191-49a5-a3f6-8b9b7f3a6cb6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.197602 Sep 22 15:00:16.642979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 181/360] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:16 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:16.841473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:16.842238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:16.849960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:16.850513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:16.851045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:16.852419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:16.852932 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:16.853422 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:16.991003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:16.999680 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fafebb8a-2e09-406d-9dd9-add515989e8f tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1502 microversion: 2.1 time: 0.162828 Sep 22 15:00:17.000508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 180/361] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:16 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:17.110991 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:17.111700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:17.122106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.123101 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.123575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.124284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.125037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.125672 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.143525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-c8250a8a-afae-4f3a-9d09-12d9f4647b5c req-a8c8f141-b624-486b-a95d-ea9410ef85f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e3e987-00d8-40fb-8460-893016f4831e", "tag": "d8489e08-1ba1-4d97-9eba-70205d841cb9"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:17.151108 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:17.163047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8250a8a-afae-4f3a-9d09-12d9f4647b5c req-a8c8f141-b624-486b-a95d-ea9410ef85f7 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.164346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8250a8a-afae-4f3a-9d09-12d9f4647b5c req-a8c8f141-b624-486b-a95d-ea9410ef85f7 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.165059 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8250a8a-afae-4f3a-9d09-12d9f4647b5c req-a8c8f141-b624-486b-a95d-ea9410ef85f7 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.193521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-c8250a8a-afae-4f3a-9d09-12d9f4647b5c req-a8c8f141-b624-486b-a95d-ea9410ef85f7 service nova] Creating event network-changed:d8489e08-1ba1-4d97-9eba-70205d841cb9 for instance c3e3e987-00d8-40fb-8460-893016f4831e on hv-cinder-84456 Sep 22 15:00:17.201588 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-c8250a8a-afae-4f3a-9d09-12d9f4647b5c req-a8c8f141-b624-486b-a95d-ea9410ef85f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065723 Sep 22 15:00:17.202292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 181/362] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:17.321344 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:17.330229 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4c023bca-e64a-442f-b424-a1770a09ad60 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.223716 Sep 22 15:00:17.331554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 182/363] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:17 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:17.666853 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:17.667655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:17.673780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.674264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.674706 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.675434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.675890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.676315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.809192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:17.817018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ec9cd8d5-3698-4d71-8ef0-c9786843f5c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.154885 Sep 22 15:00:17.819060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 182/364] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:17 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:17.884234 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cc37425-e9ca-4f34-9a1b-9b430ba90726"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:17.886752 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:17.893896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.894394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.894878 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.895611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.896251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.896815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.918797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:17.919338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:17.925547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.926027 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.926493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.927331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:17.927745 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:17.928166 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:17.951323 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lazy-loading 'flavor' on Instance uuid c45e6623-9952-42a0-b01e-85001ae14fd2 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:00:18.143988 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f312cee4-624c-4aab-a369-a4cae281703a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/action" status: 202 len: 0 microversion: 2.20 time: 0.228890 Sep 22 15:00:18.144569 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 183/365] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 22 15:00:17 2022] POST /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 22 15:00:18.150209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:18.150942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:18.157126 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.157614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.158050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.158752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.159235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.159664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.192735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.193236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.193679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.194124 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lazy-loading 'fault' on Instance uuid da636b74-755d-4f4b-a681-b9d3241413af {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:00:18.235115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6465d1250d2146b2be8d17a70b8bb929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495d28624eac48069fdff279e2f1b001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:18.243355 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d8540fe3-6225-4c12-9646-61bbe8f568b3 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 200 len: 1303 microversion: 2.1 time: 0.097719 Sep 22 15:00:18.243912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 184/366] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:18 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:18.254875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:18.254875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:18.254875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.254875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.255227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.255694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.256143 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.256559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.383719 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:18.391964 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:18.393427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:18.394587 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c8317e3e-70fd-4276-bfa4-b015972a6a25 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.149782 Sep 22 15:00:18.395175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 185/367] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:18 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:18.399488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:18.400093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:18.405800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.406290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.406750 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.407481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.407939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.408365 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.538232 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:18.546476 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-99468af0-e785-4685-94b5-08c799ac79b3 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.150355 Sep 22 15:00:18.547077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 186/368] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:18 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:18.843584 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:18.845462 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:18.857810 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.858441 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.859386 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:18.861208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:18.861208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:18.861634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.007531 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:19.016448 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b04b1643-21fc-4884-9710-7f42b1739887 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.178752 Sep 22 15:00:19.017345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 187/369] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:18 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:19.147823 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9e450897-0d62-45d3-9aca-292a6647f1da tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.267530 Sep 22 15:00:19.149195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 183/370] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:00:17 2022] POST /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments => generated 194 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:00:19.217957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-2f4586f9-a92d-455f-9f18-69cf9763826e req-d0846999-d490-4b23-a2e0-e747a7dc1271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da636b74-755d-4f4b-a681-b9d3241413af", "name": "network-vif-deleted", "tag": "de2f3219-dc9c-4db5-9268-ea7773e7dc7a"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:19.227283 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2f4586f9-a92d-455f-9f18-69cf9763826e req-d0846999-d490-4b23-a2e0-e747a7dc1271 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:19.227838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2f4586f9-a92d-455f-9f18-69cf9763826e req-d0846999-d490-4b23-a2e0-e747a7dc1271 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:19.228377 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2f4586f9-a92d-455f-9f18-69cf9763826e req-d0846999-d490-4b23-a2e0-e747a7dc1271 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.241384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-2f4586f9-a92d-455f-9f18-69cf9763826e req-d0846999-d490-4b23-a2e0-e747a7dc1271 service nova] Creating event network-vif-deleted:de2f3219-dc9c-4db5-9268-ea7773e7dc7a for instance da636b74-755d-4f4b-a681-b9d3241413af on hv-cinder-84456 Sep 22 15:00:19.246472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-2f4586f9-a92d-455f-9f18-69cf9763826e req-d0846999-d490-4b23-a2e0-e747a7dc1271 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032387 Sep 22 15:00:19.247346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 188/371] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:19.267666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:19.268523 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] [instance: da636b74-755d-4f4b-a681-b9d3241413af] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:19.275778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:19.276282 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:19.276717 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.277410 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:19.277892 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:19.278345 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.291557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] HTTP exception thrown: Instance da636b74-755d-4f4b-a681-b9d3241413af could not be found. Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Request method failure captured: Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af HTTP/1.1 Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHhGcrOL-SxfWd-RXlKdQJV2L9_7qdMmEDg8ZpjodaYLP9JFMCSNH8mx2PQNv01e5shZw0taCXTJbdv6YP2m7LDok2IHdUtTG8q0OHtv3mcVnW7GFTSz8NwN50ZxrP8eTDTwVUDBxe4_LlQNINpod7cLSKjOijEAJjwQ8PBZYrx8rNE Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 495d28624eac48069fdff279e2f1b001 Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesActionsTest-2030161344 Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:00:19.293166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/495d28624eac48069fdff279e2f1b001"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_495d28624eac48069fdff279e2f1b001"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/495d28624eac48069fdff279e2f1b001"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/495d28624eac48069fdff279e2f1b001"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesActionsTest-2030161344 Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 495d28624eac48069fdff279e2f1b001 Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesActionsTest-2030161344 Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesActionsTest-2030161344-project Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 6465d1250d2146b2be8d17a70b8bb929 Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesActionsTest-2030161344-project Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance da636b74-755d-4f4b-a681-b9d3241413af could not be found. Sep 22 15:00:19.294623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'da636b74-755d-4f4b-a681-b9d3241413af'} Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da636b74-755d-4f4b-a681-b9d3241413af could not be found. Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:00:19.295578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da636b74-755d-4f4b-a681-b9d3241413af could not be found. Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da636b74-755d-4f4b-a681-b9d3241413af could not be found. Sep 22 15:00:19.297049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:19.298340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] Returning 404 to user: Instance da636b74-755d-4f4b-a681-b9d3241413af could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:00:19.298340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-43cc78e7-1610-404a-88b2-a643fc2be738 tempest-VolumesActionsTest-2030161344 tempest-VolumesActionsTest-2030161344-project] 10.222.0.26 "GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af" status: 404 len: 111 microversion: 2.1 time: 0.031179 Sep 22 15:00:19.298340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 184/372] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:19 2022] GET /compute/v2.1/servers/da636b74-755d-4f4b-a681-b9d3241413af => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:00:19.420513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:19.421220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:19.433566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:19.434077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:19.434507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.435239 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:19.435686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:19.436111 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.571443 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:19.572081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:19.587033 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:19.588054 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:19.588508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.589680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:19.590290 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:19.590935 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:19.752813 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:19.768832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:19.773429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:19.778701 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-33cfbe64-c277-4710-84c6-289468202179 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.362508 Sep 22 15:00:19.779303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 189/373] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:19 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:19.791214 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:19.799190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ac16cdc1-6b74-457c-b721-f04f8adc9346 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.229121 Sep 22 15:00:19.803365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 185/374] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:19 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:20.039458 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:20.040075 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:20.046052 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:20.047342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:20.047342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:20.049109 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:20.049958 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:20.050476 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:20.186628 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:20.194329 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1a816810-4336-42d1-8e9a-b0f42d34026d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.158727 Sep 22 15:00:20.195470 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 190/375] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:20 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:20.808747 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:20.809312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:20.815827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:20.816501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:20.817063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:20.817804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:20.818262 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:20.818695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:20.819574 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:20.820688 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:20.826947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:20.827429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:20.827866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:20.828559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:20.829009 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:20.829433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:21.017089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:21.020147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:21.022457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:21.026050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:21.027536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:21.028712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e065c4f1-007f-44d2-a78f-e14cb92aa023 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.224026 Sep 22 15:00:21.029092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-39046bec-44f3-4b8c-8c1b-b2d0b0dbaded tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.213459 Sep 22 15:00:21.029587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 186/376] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:20 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:21.031174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 191/377] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:20 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:21.217682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:21.218285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:21.224319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:21.224793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:21.225221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:21.226015 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:21.227020 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:21.227442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:21.380951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:21.389274 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5ab2ff12-831b-465f-b464-87d44eb0508e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.175577 Sep 22 15:00:21.389767 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 187/378] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:21 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:22.056672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:22.057239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:22.057631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:22.057756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:22.065116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:22.065453 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:22.065826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:22.066013 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:22.066397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:22.066519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:22.067185 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:22.067292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:22.067643 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:22.067860 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:22.068077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:22.068368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:22.267515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:22.271777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:22.276161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:22.277624 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:22.278992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-841982b3-ae7d-4c85-bc95-bbff57d35a98 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.227707 Sep 22 15:00:22.279557 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 192/379] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:22 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:22.279833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d4e98b31-756f-4c39-a240-11dfc2103b95 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.227716 Sep 22 15:00:22.280520 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 188/380] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:22 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:22.413925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:22.414555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:22.420517 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:22.420998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:22.421435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:22.422161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:22.422617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:22.423101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:22.550381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:22.558338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7d1246af-25ac-46b5-a3c9-e7c1b241439d tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.148766 Sep 22 15:00:22.558941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 193/381] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:22 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:23.304672 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:23.305260 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:23.307749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:23.308793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=8 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:23.313530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:23.314075 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:23.314290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:23.314812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:23.315270 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:23.315985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:23.316440 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:23.317155 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:23.321045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:23.321530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:23.321960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:23.327023 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:23.327506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:23.327943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:23.532810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:23.541402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-210b7187-5bfd-44e6-aa82-8c3931f7806d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.241063 Sep 22 15:00:23.542122 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 189/382] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:23 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:23.550013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:23.559253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:23.560726 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:23.561896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-79dd0f97-9580-451c-9967-eebe8e51e980 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.261449 Sep 22 15:00:23.562456 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 194/383] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:23 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:23.581931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:23.582166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:23.588364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:23.589105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:23.589540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:23.590239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:23.590697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:23.591291 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:23.720466 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:23.728786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-64784496-98f6-4ca6-8ea6-61a0f75a0830 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.151248 Sep 22 15:00:23.729390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 190/384] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:23 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:24.565806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:24.567013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:24.576881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:24.578054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:24.578842 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:24.580031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:24.580814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:24.581315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:24.597138 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:24.598402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:24.610168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:24.611314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:24.612922 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:24.614648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:24.615801 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:24.617013 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:24.779279 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:24.793494 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-71463433-0a1e-4d36-9946-d89983e391b1 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.231610 Sep 22 15:00:24.797598 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 195/385] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:24 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:24.804865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:24.806496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:24.816465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:24.817643 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:24.818590 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:24.820659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:24.821614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:24.822605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:24.874148 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:24.884843 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:24.892648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:24.894359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9a3d2a3a-0719-4158-9231-6845b85c6e7a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.308971 Sep 22 15:00:24.895457 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 191/386] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:24 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:25.036040 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:25.047558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3de020cb-ddf6-4c3d-9862-36e6ef596aef tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.248224 Sep 22 15:00:25.048539 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 196/387] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:24 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:25.176769 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-6652f1ce-63ce-4356-9130-47ce3cf3a563 req-8ac4c783-e773-4634-81b9-02dffadd525c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e3e987-00d8-40fb-8460-893016f4831e", "name": "network-vif-plugged", "status": "completed", "tag": "d8489e08-1ba1-4d97-9eba-70205d841cb9"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:25.199563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6652f1ce-63ce-4356-9130-47ce3cf3a563 req-8ac4c783-e773-4634-81b9-02dffadd525c service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:25.201868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6652f1ce-63ce-4356-9130-47ce3cf3a563 req-8ac4c783-e773-4634-81b9-02dffadd525c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:25.202443 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-6652f1ce-63ce-4356-9130-47ce3cf3a563 req-8ac4c783-e773-4634-81b9-02dffadd525c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:25.229418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-6652f1ce-63ce-4356-9130-47ce3cf3a563 req-8ac4c783-e773-4634-81b9-02dffadd525c service nova] Creating event network-vif-plugged:d8489e08-1ba1-4d97-9eba-70205d841cb9 for instance c3e3e987-00d8-40fb-8460-893016f4831e on hv-cinder-84456 Sep 22 15:00:25.244331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-6652f1ce-63ce-4356-9130-47ce3cf3a563 req-8ac4c783-e773-4634-81b9-02dffadd525c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071014 Sep 22 15:00:25.245422 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 192/388] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:25.821727 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:25.822574 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:25.829669 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:25.830412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:25.831018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:25.831887 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:25.832713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:25.833404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:25.926845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:25.928747 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:25.936825 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:25.937659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:25.938327 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:25.939275 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:25.939935 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:25.940577 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:26.069221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:26.085330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-07aedc5e-f754-4aee-8585-0a24bad9f2e6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.267104 Sep 22 15:00:26.087001 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 197/389] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:25 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:26.093709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:26.094832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:26.101674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:26.102556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:26.103346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:26.104296 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:26.104979 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:26.105617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:26.230833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:26.250555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:26.253123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:26.254362 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7ceb73f1-e141-493a-aea6-911405d44bab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.333179 Sep 22 15:00:26.254996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 193/390] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:25 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:26.322244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:26.339275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7350ed32-24e3-4985-acec-066bd0d1e2c8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.249969 Sep 22 15:00:26.349596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 198/391] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:26 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:26.749265 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2d84d209-9fe5-45bd-a657-6129db6a75ae tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: .version_select at 0x7f77e6638ee0>, body: {"keypair": {"name": "tempest-keypair-1739853075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgW/1zA0MXQo08A8t1ClJKr8fZktimUxOtYnAHYIslDuFXAUd6oe5srLxlOZVCHLROH620PNd5fxmnq1QNiLiZT/Fi77Xg65kSyJCwM7D25yhZRGiTaSBNo60lOErwsvg=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:26.761791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:26.767764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-2d84d209-9fe5-45bd-a657-6129db6a75ae tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:00:26.773913 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-2d84d209-9fe5-45bd-a657-6129db6a75ae tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:00:26.797844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2d84d209-9fe5-45bd-a657-6129db6a75ae tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052178 Sep 22 15:00:26.802773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 194/392] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:00:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:27.120904 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:27.121752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:27.127878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:27.128652 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:27.129264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:27.129970 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:27.130416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:27.130856 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:27.281806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:27.283173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:27.295077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:27.295626 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:27.299101 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:27.300057 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:27.300518 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:27.300944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:27.328932 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:27.341248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-62e292dc-de43-48bc-9b2c-8b192c1dbe1f tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.228090 Sep 22 15:00:27.342381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 199/393] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:27 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:27.369003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:27.369762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:27.376427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:27.377133 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:27.377802 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:27.378826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:27.379437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:27.380141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:27.579412 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:27.587348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:27.591717 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:27.596654 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:27.598090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0e47ab33-dca4-4583-83a4-18137f033728 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.232771 Sep 22 15:00:27.615634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 200/394] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:27 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:27.615850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79865f59-f3fd-4bdd-9f31-d2a540d43677 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.321813 Sep 22 15:00:27.615850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 195/395] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:27 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:28.366591 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:28.367223 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:28.380319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:28.381113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:28.381744 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:28.383389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:28.384057 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:28.384638 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:28.551439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:28.563236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-eaf4d26b-ec1b-483e-a756-1622388c243b tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1319 microversion: 2.1 time: 0.200332 Sep 22 15:00:28.564133 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 201/396] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:28 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:28.626267 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:28.629632 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1659392322", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff6bd501-2fb8-4ba1-b730-2cab6c908602"}], "security_groups": [{"name": "tempest-securitygroup--1376518662"}], "key_name": "tempest-keypair-1739853075", "user_data": "}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:28.636753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:28.643758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:28.644250 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:28.644689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:28.645394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:28.645933 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:28.646275 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:28.819414 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] validate_networks() for [('ff6bd501-2fb8-4ba1-b730-2cab6c908602', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:00:28.908439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:28.932359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1ae79a37-1aff-40d6-b490-dab82da13c31 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1501 microversion: 2.1 time: 0.312196 Sep 22 15:00:28.933116 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 196/397] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:28 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1501 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:28.949024 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:28.950070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:28.960830 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:28.961605 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:28.962390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:28.964099 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:28.964873 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:28.965738 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.217159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:29.226496 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:29.228327 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:29.229628 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-45289bb1-af59-473c-9798-ef0e61808a1f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.291111 Sep 22 15:00:29.230411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 197/398] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:28 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:29.238595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8e1d458-c8be-4271-b615-5f26179de3bc"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:29.241226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:29.247697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.248600 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.249280 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.250232 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.250972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.251617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.286187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] HTTP exception thrown: Cannot 'attach_volume' instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe while it is in vm_state rescued Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Request method failure captured: Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe/os-volume_attachments HTTP/1.1 Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 74 Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgIMz35eZr-TOgMxIor3-RJ8UB8GkoNCikvHlilSlMfG3f6kIoqDS7rJu8k1SCoFhaU2Z5UUxc8E7pBOqBA8xmEsBh1JbrbP_k6qe6D8aiGRIwVEJsvd44JjqAqER7hoFNvQMs6kahtDcRFKgXq2Dx6AdJ4k9iRk-nXcA-qn1K-cps Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:00:29.288772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 038365d6ba7041f4af386767d98ed709 Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {"volumeAttachment": {"volumeId": "b8e1d458-c8be-4271-b615-5f26179de3bc"}} Sep 22 15:00:29.290696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Cannot 'attach_volume' instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe while it is in vm_state rescued Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'server_id': '4cdb9447-4895-42dd-bb76-06ef6acb90fe', 'body': {'volumeAttachment': {'volumeId': 'b8e1d458-c8be-4271-b615-5f26179de3bc'}}} Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:00:29.291979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe while it is in vm_state rescued Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:00:29.293621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:00:29.295153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:00:29.295153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:00:29.295153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe while it is in vm_state rescued Sep 22 15:00:29.295153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:00:29.295153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Returning 409 to user: Cannot 'attach_volume' instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe while it is in vm_state rescued {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:00:29.295153 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7f0b1a10-7f59-4314-9cb1-74b463c62f07 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058605 Sep 22 15:00:29.295985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 198/399] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:00:29 2022] POST /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 22 15:00:29.301623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:29.302380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:29.308695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.309191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.309626 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.310327 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.310800 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.311227 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.366058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:29.382035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:00:29.384636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:00:29.385536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:00:29.386217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:00:29.387020 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:00:29.393511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0899694d-2f01-4d5f-b78b-efb427c9381b tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe/action" status: 202 len: 0 microversion: 2.1 time: 0.095529 Sep 22 15:00:29.394169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 199/400] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:00:29 2022] POST /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:00:29.400308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.400795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.401225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.401947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.402395 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.402835 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.404133 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:29.405131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:29.411508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.412080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.412580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.413988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.414716 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.415361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.425399 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:00:29.431194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:00:29.435193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:29.459015 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:00:29.463244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:00:29.538807 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a3d4c01b-268c-4bcd-858f-6ca0eda205b8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917173 Sep 22 15:00:29.540072 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 202/401] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:00:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:00:29.554285 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3ef7ae0f-1965-4415-a5d0-dee4e0d65c92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:29.555713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3ef7ae0f-1965-4415-a5d0-dee4e0d65c92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:29.588256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:29.604881 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3cb46f16-b99c-4cdb-9f29-bc407405f1ed tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1509 microversion: 2.1 time: 0.205343 Sep 22 15:00:29.611812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 200/402] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:29 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:29.627250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3ef7ae0f-1965-4415-a5d0-dee4e0d65c92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:29.630007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:29.633993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:29.636436 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3ef7ae0f-1965-4415-a5d0-dee4e0d65c92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1242 microversion: 2.1 time: 0.088198 Sep 22 15:00:29.637395 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 203/403] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:29 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:29.651427 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.652245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.652926 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.653852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:29.654578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:29.655263 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:29.832772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:29.846493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-43d447dd-a88f-43a5-8b66-4e73b5ddbc9c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1508 microversion: 2.1 time: 0.231531 Sep 22 15:00:29.847223 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 201/404] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:29 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:30.262689 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:30.263587 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:30.280422 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:30.286264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:30.287421 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:30.288878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:30.289581 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:30.290093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:30.528309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:30.539391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:30.540912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:30.542098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-74ae3dec-4b2a-43d8-a51e-f79d69e5d195 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.284300 Sep 22 15:00:30.542980 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 204/405] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:30 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:30.634025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:30.635507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:30.642695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:30.643474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:30.644082 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:30.645003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:30.645635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:30.646515 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:30.662326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:30.663497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:30.670150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:30.670991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:30.671641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:30.672576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:30.673255 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:30.673763 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:30.771809 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:30.781829 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f5dce406-36f0-4bbb-b468-238de36b35c8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1294 microversion: 2.1 time: 0.125284 Sep 22 15:00:30.782408 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 205/406] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:30 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:30.870653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:30.879495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e336e452-264f-4ad5-9cef-cc71655a5a82 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1509 microversion: 2.1 time: 0.249876 Sep 22 15:00:30.880145 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 202/407] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:30 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:31.572098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:31.574019 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:31.581563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:31.582263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:31.582887 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:31.583754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:31.584394 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:31.585278 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:31.743721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:31.752619 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:31.754156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:31.755565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-30f53edb-c0c8-4099-9310-642958b36adb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.188034 Sep 22 15:00:31.756428 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 206/408] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:31 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:31.811856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:31.812609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:31.818643 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:31.819868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:31.820536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:31.821403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:31.821955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:31.822620 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:31.892884 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:31.904367 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:31.905223 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:31.906781 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-45c83c55-fe6f-4fcb-b753-f00335047211 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1294 microversion: 2.1 time: 0.098740 Sep 22 15:00:31.916439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:31.917668 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:31.918483 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:31.919381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 203/409] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:31 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:31.919684 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:31.920360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:31.921209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:32.074935 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:32.084512 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ef94d2cd-1c97-4f05-b501-7f7fcb1bc04e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1509 microversion: 2.1 time: 0.183771 Sep 22 15:00:32.085105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 207/410] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:31 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:32.782690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:32.783362 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:32.789474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:32.789950 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:32.790551 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:32.791286 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:32.791741 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:32.792347 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:32.930866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:32.932323 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:32.938776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:32.939518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:32.940120 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:32.940714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:32.941171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:32.941628 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:32.991204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:33.003644 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:33.006124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:33.008008 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e773d616-0c86-4d9c-8d1b-80e23124f9e8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.229697 Sep 22 15:00:33.008918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 204/411] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:32 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:33.022830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:33.033364 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-572ce52b-6bba-4a4d-a4f6-82b190be3c85 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1294 microversion: 2.1 time: 0.106919 Sep 22 15:00:33.034089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 208/412] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:32 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:33.110292 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:33.110939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:33.117880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:33.118503 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:33.119139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:33.120392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:33.120902 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:33.121456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:33.277833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:33.288486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d817a6f6-a7b2-4f0e-be14-7dd5147bb748 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1515 microversion: 2.1 time: 0.181767 Sep 22 15:00:33.304114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 205/413] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:33 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:34.037408 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:34.038318 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:34.046460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:34.046993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:34.047532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:34.048457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:34.048835 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:34.049346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:34.061278 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:34.064382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:34.074528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:34.075709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:34.076346 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:34.077317 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:34.077970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:34.078581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:34.188628 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:34.200325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-05389184-1dce-43a8-bff7-6c295c239ece tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1300 microversion: 2.1 time: 0.144231 Sep 22 15:00:34.217188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 206/414] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:34 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:34.220985 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:34.230538 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:34.232082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:34.233462 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-02d490de-ef5e-4b75-a323-6f566fcfcfba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.201317 Sep 22 15:00:34.234344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 209/415] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:34 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:34.801624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-acc424e7-e408-42a5-8117-6757137ad2df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'create', calling method: .version_select at 0x7f77e6638790>, body: {"keypair": {"name": "tempest-keypair-1566355206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqzIyfljq/z70wW+I+eLFQ+EYYvrvNI8daJJthHM3tMTa3157H6zvRwI5EPpMVc8ritXUDccGslAFgGztiffnQV7ZY/cbTdskln/Liu5D6Wc0W9TbJexFl2yFJHMjhzHA=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:34.826382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-acc424e7-e408-42a5-8117-6757137ad2df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:00:34.831852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-acc424e7-e408-42a5-8117-6757137ad2df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for user 038365d6ba7041f4af386767d98ed709 and project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:00:34.870277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-acc424e7-e408-42a5-8117-6757137ad2df tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072440 Sep 22 15:00:34.872491 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 207/416] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:00:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:35.229026 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:35.230857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:35.241266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:35.242833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:35.243566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:35.244751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:35.245532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:35.246170 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:35.249687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:35.267871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:35.269150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:35.286998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:35.287799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:35.288438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:35.289568 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:35.290213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:35.290851 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:35.625453 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:35.646759 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d6406372-5eb6-488f-b7a2-13ee5d5fc05c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.422065 Sep 22 15:00:35.649069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 210/417] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:35 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:35.654472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-c31dcc19-e66e-43ba-b3d4-61562e2cdb24 req-74262791-7e21-4570-82dc-176469121e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94107fe0-4109-4907-9e8c-2f48a0b6ea23", "tag": "90340433-4cf8-4079-bfef-08ee8c826ec0"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:35.672511 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c31dcc19-e66e-43ba-b3d4-61562e2cdb24 req-74262791-7e21-4570-82dc-176469121e5b service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:35.672718 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:35.673784 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c31dcc19-e66e-43ba-b3d4-61562e2cdb24 req-74262791-7e21-4570-82dc-176469121e5b service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:35.674418 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c31dcc19-e66e-43ba-b3d4-61562e2cdb24 req-74262791-7e21-4570-82dc-176469121e5b service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:35.689728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:35.691815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:35.694335 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dca79279-8304-47bc-8dbd-c5cc6a0e9580 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.430584 Sep 22 15:00:35.698263 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 208/418] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:35 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:35.713822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-c31dcc19-e66e-43ba-b3d4-61562e2cdb24 req-74262791-7e21-4570-82dc-176469121e5b service nova] Creating event network-changed:90340433-4cf8-4079-bfef-08ee8c826ec0 for instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 on hv-cinder-84456 Sep 22 15:00:35.721925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-c31dcc19-e66e-43ba-b3d4-61562e2cdb24 req-74262791-7e21-4570-82dc-176469121e5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071354 Sep 22 15:00:35.722542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 211/419] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:36.673728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:36.674374 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:36.687802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:36.688392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:36.689671 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:36.690982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:36.692090 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:36.692595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:36.729429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:36.730785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:36.758771 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:36.758771 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:36.765404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:36.768828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:36.769330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:36.772123 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:37.074202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:37.082653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-51321bb3-3297-47bd-b427-f1e7f4d2b4df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.413669 Sep 22 15:00:37.099195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 209/420] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:36 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:37.166152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:37.180759 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:37.185046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:37.188110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6342b1df-5b0b-439a-87f2-2a6ff73e2057 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.464740 Sep 22 15:00:37.190055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 212/421] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:36 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:37.612686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-205420762", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f14ce68-55c9-40b3-aeec-c68d94f2dd1a"}], "security_groups": [{"name": "tempest-securitygroup--662314568"}], "key_name": "tempest-keypair-1566355206", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:38.110092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:38.110760 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:38.117356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:38.118112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:38.118724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:38.119535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:38.119990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:38.120420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:38.262355 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:38.270118 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d4544903-09c0-4155-a831-4a1a7ad9eb20 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.165820 Sep 22 15:00:38.270681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 213/422] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:38 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:38.275734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:38.276339 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:38.281953 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:38.282433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:38.282906 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:38.283604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:38.284060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:38.284484 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:38.434687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:38.444171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:38.445736 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:38.447010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-01ff58a4-8934-4e04-b116-ac92e8fe921a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.175342 Sep 22 15:00:38.447759 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 214/423] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:38 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:39.295004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:39.295709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:39.301920 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:39.302398 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:39.302854 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:39.307711 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:39.307711 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:39.307711 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:39.416008 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:39.472823 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:39.487970 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-22150c30-ebb4-40df-aa00-ed418b9a32ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.196356 Sep 22 15:00:39.489784 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 215/424] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:39 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:39.497225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:39.498082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:39.504058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:39.504577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:39.504987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:39.505699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:39.506159 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:39.506599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:39.636522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=8 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:39.659265 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:39.667915 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:39.669400 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:39.670566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f7c9f042-6222-4762-81f4-17cb37fb7143 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1745 microversion: 2.20 time: 0.179432 Sep 22 15:00:39.682793 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 216/425] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:39 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:40.520432 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:40.521516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:40.528196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:40.528691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:40.539905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:40.539905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:40.539905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:40.539905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:40.704388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:40.712986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-226d3f13-20f5-47a3-95aa-aaf291f6b45a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.196702 Sep 22 15:00:40.726986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 217/426] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:40 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:40.726986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:40.726986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:40.726986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:40.727474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:40.727600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:40.731003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:40.731003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:40.731003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:40.905031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:40.914148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:40.915540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:40.916747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-df30c205-e4bd-46ce-9571-2341b5989f2e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1745 microversion: 2.20 time: 0.201861 Sep 22 15:00:40.917869 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 218/427] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:40 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:41.739623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:41.740280 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:41.746990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:41.747548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:41.748244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:41.749039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:41.749580 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:41.750021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:41.888830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:41.898688 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b0466859-7784-4a15-8289-14dd45bff11e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.163826 Sep 22 15:00:41.899282 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 219/428] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:41 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:41.943695 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:41.944616 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:41.950595 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:41.951110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:41.951552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:41.952236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:41.952702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:41.953117 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:42.112064 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:42.121129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:42.122798 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:42.123995 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7bbfa802-058b-4f66-8ded-dac8561665f3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1745 microversion: 2.20 time: 0.184472 Sep 22 15:00:42.138481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 220/429] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:41 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:42.925517 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:42.926334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:42.932338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:42.932927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:42.933371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:42.934409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:42.934616 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:42.935062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:43.082582 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:43.094123 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1e02d27a-af5b-47dd-bf03-b8b94f8b17c7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.172984 Sep 22 15:00:43.095370 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 221/430] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:42 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:43.153252 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:43.153806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:43.172223 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:43.173822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:43.174534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:43.175543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:43.176251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:43.177493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:43.369976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:43.381029 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:43.383676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:43.385088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-66d4f91d-62cb-4079-8981-a7ac1e600ede tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1745 microversion: 2.20 time: 0.236727 Sep 22 15:00:43.385661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 222/431] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:43 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:43.391159 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-4b3377d4-9646-41f8-ab13-9041d359becd req-969dfbbe-a676-41c6-b208-2ac9fe784d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45e6623-9952-42a0-b01e-85001ae14fd2", "name": "network-vif-plugged", "status": "completed", "tag": "ecbef20d-ee6a-4cae-8583-7ab49d776a37"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:43.403008 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4b3377d4-9646-41f8-ab13-9041d359becd req-969dfbbe-a676-41c6-b208-2ac9fe784d00 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:43.403726 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4b3377d4-9646-41f8-ab13-9041d359becd req-969dfbbe-a676-41c6-b208-2ac9fe784d00 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:43.404375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4b3377d4-9646-41f8-ab13-9041d359becd req-969dfbbe-a676-41c6-b208-2ac9fe784d00 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:43.416928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-4b3377d4-9646-41f8-ab13-9041d359becd req-969dfbbe-a676-41c6-b208-2ac9fe784d00 service nova] Creating event network-vif-plugged:ecbef20d-ee6a-4cae-8583-7ab49d776a37 for instance c45e6623-9952-42a0-b01e-85001ae14fd2 on hv-cinder-84456 Sep 22 15:00:43.422608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-4b3377d4-9646-41f8-ab13-9041d359becd req-969dfbbe-a676-41c6-b208-2ac9fe784d00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035735 Sep 22 15:00:43.429453 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 223/432] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:44.120071 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:44.120758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:44.128122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:44.128465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:44.128904 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:44.129608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:44.130064 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:44.130488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:44.279885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:44.287824 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-56c4365b-e4e5-4fef-9ccc-257231bbc1b2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.171990 Sep 22 15:00:44.288424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 224/433] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:44 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:44.411639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:44.412201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:44.419147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:44.419642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:44.420086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:44.420809 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:44.421277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:44.421712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:44.571329 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:44.581561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:44.583437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:44.585236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-28c87972-9f40-4079-b35d-a2c5d7a0252a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.177457 Sep 22 15:00:44.586319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 225/434] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:44 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:44.842414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=8 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:45.314712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:45.315507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:45.323623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:45.324308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:45.324753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:45.325735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:45.327355 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:45.327355 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:45.560776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:45.570777 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c6162f4a-f9a8-4157-86c4-a634a41252a9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.263172 Sep 22 15:00:45.571621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 226/435] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:45 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:45.613314 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:45.613933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:45.620906 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:45.621397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:45.621838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:45.622696 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:45.623183 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:45.623716 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:45.778077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:45.786420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:45.787973 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:45.789294 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1e44aadc-0c7d-4f4b-b7e1-521e97cadb85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.180006 Sep 22 15:00:45.792497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 227/436] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:45 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:46.595515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:46.596168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:46.602181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:46.602664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:46.603140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:46.603834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:46.604398 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:46.604954 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:46.610795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:46.761398 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:46.769634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ad85df8a-0e10-48a2-8f9a-5ede563dbefe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.179182 Sep 22 15:00:46.770183 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 228/437] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:46 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:46.815319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:46.815928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:46.821872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:46.822343 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:46.822792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:46.823551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:46.824001 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:46.824431 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:46.828553 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] validate_networks() for [('5f14ce68-55c9-40b3-aeec-c68d94f2dd1a', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:00:47.029873 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:47.039026 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:47.040474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:47.041650 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-048efd74-f504-4d94-bd0c-bb1a27496bbe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.230310 Sep 22 15:00:47.042216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 229/438] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:46 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:47.084641 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:47.277375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:00:47.277794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:00:47.278266 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:00:47.278669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:00:47.279119 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:00:47.289141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:47.289141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:47.289454 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:47.290183 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:47.290654 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:47.291107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:47.308420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:00:47.313192 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Getting quotas for user 038365d6ba7041f4af386767d98ed709 and project 6a15aa877b1b482fa70f65ecd4f8d1f3. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:00:47.325195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:00:47.327803 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:00:47.382230 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cee62917-1ce0-4bc6-8a8f-9bffa4eadd46 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.773867 Sep 22 15:00:47.383024 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 210/439] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:00:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 9775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:00:47.394097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b0d27509-2993-45ae-b499-57a33cb94b15 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:47.394854 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b0d27509-2993-45ae-b499-57a33cb94b15 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:47.450176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b0d27509-2993-45ae-b499-57a33cb94b15 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:47.456996 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b0d27509-2993-45ae-b499-57a33cb94b15 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1245 microversion: 2.1 time: 0.066726 Sep 22 15:00:47.461058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 230/440] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:47 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:47.792911 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:47.793533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:47.800045 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:47.800533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:47.800974 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:47.801676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:47.802267 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:47.802841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:47.943783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:47.953529 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-14f1f4d9-0acc-4a49-ada2-703e84e10833 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.164658 Sep 22 15:00:47.954761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 211/441] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:47 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:48.070440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:48.071063 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:48.078153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:48.078713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:48.079198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:48.080058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:48.080521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:48.080951 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:48.220814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:48.229396 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:48.231015 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:48.232338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c901f836-fefa-4289-b3de-374fad764709 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.167548 Sep 22 15:00:48.232901 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 231/442] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:48 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:48.482961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:48.486793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:48.494065 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:48.494656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:48.495180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:48.496048 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:48.496572 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:48.497134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:48.610753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:48.624936 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-34302211-a5a1-4567-ac7c-47fca54c2587 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1297 microversion: 2.1 time: 0.147154 Sep 22 15:00:48.625828 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 212/443] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:48 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:48.978497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:48.979215 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:48.986246 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:48.987106 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:48.987604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:48.988375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:48.989209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:48.989713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:49.151415 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:49.164682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f497e175-282a-4410-9946-5c2022f300e5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.188524 Sep 22 15:00:49.167135 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 232/444] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:48 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:49.259879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:49.260815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:49.290331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:49.291169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:49.291859 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:49.292508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:49.295210 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:49.295680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:49.570186 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:49.584948 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:49.591936 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:49.593523 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0d26c0fa-9416-4791-af82-5857c5ece9db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.338615 Sep 22 15:00:49.594309 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 213/445] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:49 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:49.654051 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:49.654806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:49.662451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:49.667209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:49.668006 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:49.670708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:49.671602 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:49.673690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:49.905830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:49.935649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7c53fc34-8fd9-4c04-9aef-2b1dd3f294f4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1303 microversion: 2.1 time: 0.282481 Sep 22 15:00:49.936816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 233/446] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:49 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1303 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:50.190972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:50.191628 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:50.205764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:50.209692 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:50.210148 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:50.210928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:50.211393 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:50.211820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:50.496920 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:50.505853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0d590bc4-c13b-4353-9a59-656d32ce4a32 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.319801 Sep 22 15:00:50.510014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 214/447] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:50 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:50.624512 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:50.625786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:50.636233 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:50.639486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:50.641279 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:50.642271 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:50.643997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:50.644759 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:50.896556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:50.921326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:50.924725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:50.931791 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-99a584f0-d5af-4220-a7ea-cd1b68ae1c1c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.311096 Sep 22 15:00:50.932819 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 234/448] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:50 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:50.975930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:50.976809 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:50.991377 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:50.994253 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:50.998765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:51.002282 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:51.002869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:51.003321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:51.244376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:51.255199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0c2a8517-a432-42c2-9e34-4d27d96ca691 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1370 microversion: 2.1 time: 0.282973 Sep 22 15:00:51.256596 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 215/449] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:50 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:51.442584 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-a2f7eb6a-90e5-4be1-9d4e-f49b4bd287a5 req-abead6fd-ac28-489e-828e-f9d471bba285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94107fe0-4109-4907-9e8c-2f48a0b6ea23", "name": "network-vif-plugged", "status": "completed", "tag": "90340433-4cf8-4079-bfef-08ee8c826ec0"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:51.461077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-a2f7eb6a-90e5-4be1-9d4e-f49b4bd287a5 req-abead6fd-ac28-489e-828e-f9d471bba285 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:51.464554 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-a2f7eb6a-90e5-4be1-9d4e-f49b4bd287a5 req-abead6fd-ac28-489e-828e-f9d471bba285 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:51.466010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-a2f7eb6a-90e5-4be1-9d4e-f49b4bd287a5 req-abead6fd-ac28-489e-828e-f9d471bba285 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:51.484675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-a2f7eb6a-90e5-4be1-9d4e-f49b4bd287a5 req-abead6fd-ac28-489e-828e-f9d471bba285 service nova] Creating event network-vif-plugged:90340433-4cf8-4079-bfef-08ee8c826ec0 for instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 on hv-cinder-84456 Sep 22 15:00:51.506578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-a2f7eb6a-90e5-4be1-9d4e-f49b4bd287a5 req-abead6fd-ac28-489e-828e-f9d471bba285 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065759 Sep 22 15:00:51.507955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 235/450] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:00:51.533521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:51.534299 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:51.542773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:51.543487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:51.544017 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:51.544970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:51.546046 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:51.546169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:51.700937 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-c80d782d-a6eb-42e2-90a7-cde935139426 req-d8bc94c9-2d28-4fe8-9bf0-884f11676eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd72afb-0e38-47ae-a54e-2667b786a75b", "tag": "643356c5-34f7-492b-a963-cdc7638a5c5a"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:51.726523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c80d782d-a6eb-42e2-90a7-cde935139426 req-d8bc94c9-2d28-4fe8-9bf0-884f11676eb3 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:51.727149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c80d782d-a6eb-42e2-90a7-cde935139426 req-d8bc94c9-2d28-4fe8-9bf0-884f11676eb3 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:51.728702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c80d782d-a6eb-42e2-90a7-cde935139426 req-d8bc94c9-2d28-4fe8-9bf0-884f11676eb3 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:51.751469 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-c80d782d-a6eb-42e2-90a7-cde935139426 req-d8bc94c9-2d28-4fe8-9bf0-884f11676eb3 service nova] Creating event network-changed:643356c5-34f7-492b-a963-cdc7638a5c5a for instance 0cd72afb-0e38-47ae-a54e-2667b786a75b on hv-cinder-84456 Sep 22 15:00:51.764140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-c80d782d-a6eb-42e2-90a7-cde935139426 req-d8bc94c9-2d28-4fe8-9bf0-884f11676eb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067497 Sep 22 15:00:51.772753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 236/451] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:51.786475 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:51.800635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f9508a00-8043-4f01-9051-2c231036be7d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.270973 Sep 22 15:00:51.801678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 216/452] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:51 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:51.958863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:51.959999 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:51.974555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:51.975078 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:51.976068 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:51.976975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:51.977222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:51.977651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:52.273735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:52.286873 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:52.289773 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:52.291801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-752a8b18-85ad-4401-b8d2-a0f4fdad3758 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.337691 Sep 22 15:00:52.292672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 237/453] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:51 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:52.300951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:52.306121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:52.316456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:52.319526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:52.320939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:52.322476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:52.327251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:52.327966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:52.775996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:52.785245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-eb320815-06e5-4238-a401-5f0e8aee2ad3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1370 microversion: 2.1 time: 0.488065 Sep 22 15:00:52.801797 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 217/454] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:52 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1370 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:52.827588 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:52.828187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:52.834660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:52.835451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:52.836080 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:52.836961 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:52.837563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:52.837980 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:53.015821 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:53.026978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a14e8ef0-fc81-46c3-9ea1-213caf647482 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.203120 Sep 22 15:00:53.047197 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 238/455] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:52 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:53.203625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a6fa043-586e-496e-bdeb-55628a135508", "device": "/dev/sdb"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:53.207355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:53.215098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:53.215819 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:53.216406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:53.217533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:53.217990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:53.218442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:53.326973 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:53.327605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:53.334377 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:53.340389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:53.341095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:53.341866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:53.342387 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:53.345291 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:53.521652 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:53.533640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:53.535091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:53.536757 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1b6f0256-9341-4a5b-a0ba-795ee4f55103 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.213885 Sep 22 15:00:53.548990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 239/456] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:53 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:53.810688 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:53.811479 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:53.817722 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:53.818318 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:53.819299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:53.820234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:53.820692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:53.821296 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:53.980231 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:53.991628 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ecc3077e-a4c6-4eea-89d0-91d9de239f12 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1370 microversion: 2.1 time: 0.186394 Sep 22 15:00:53.992643 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 240/457] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:53 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:54.071099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:54.072074 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:54.079158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:54.080042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:54.080474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:54.081173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:54.081622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:54.082038 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:54.250153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:54.259341 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dcc611a4-a993-4f9b-958c-78cbf40a653d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1368 microversion: 2.1 time: 0.193179 Sep 22 15:00:54.260003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 241/458] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:54 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:54.563597 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:54.564656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:54.571573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:54.572862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:54.573990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:54.576275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:54.577437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:54.578286 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:54.809439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:54.825312 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:54.826936 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:54.828402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7802bf8e-29f7-4cf7-bc1d-94bc4c8e61b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.268908 Sep 22 15:00:54.829120 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 242/459] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:54 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:55.020298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:55.021621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:55.028703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.029191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.029797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:55.030674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.031380 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.031811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:55.206151 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:55.215271 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-414c12c0-c9b9-4526-a329-729cb55fc8cf tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1370 microversion: 2.1 time: 0.198623 Sep 22 15:00:55.216403 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 243/460] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:55 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:00:55.281664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:55.282381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:55.290043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.290529 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.291205 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:55.291916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.292528 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.293112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:55.509916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:55.519603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bee63a75-0690-42bb-99c1-169401ffce92 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1559 microversion: 2.1 time: 0.241874 Sep 22 15:00:55.521180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 244/461] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:55 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1559 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:55.546510 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:55.549335 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:55.558590 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.559435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.560099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:55.561262 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.562011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.562441 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:55.645247 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-28fa1fe0-e025-42c0-9529-322eb3182959 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "POST /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.445942 Sep 22 15:00:55.646781 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 218/462] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:00:53 2022] POST /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e/os-volume_attachments => generated 194 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:00:55.715481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7908e27b-a893-4b68-8f55-6e9787ba0c9f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175476 Sep 22 15:00:55.716098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 245/463] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 15:00:55 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:55.862900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:55.864468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:55.878481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.879818 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.880476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:55.882238 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:55.882678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:55.883158 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:56.098252 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:56.119723 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:56.121732 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:56.124241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d88df988-fbb7-4783-832d-f32715d81bb2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.271924 Sep 22 15:00:56.129878 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 219/464] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:55 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:00:56.246244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:56.246952 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:56.255154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:56.255806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:56.257217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:56.258106 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:56.259140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:56.259927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:56.470520 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:56.499439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-19d14c1f-7777-4266-b030-01fb72ed3962 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1370 microversion: 2.1 time: 0.258754 Sep 22 15:00:56.500751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 246/465] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:56 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:57.156718 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:57.157488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:57.160350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:57.176879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:57.177378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:57.177815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:57.179507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:57.180173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:57.180828 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:57.302530 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:57.320236 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:57.369496 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:57.382205 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:57.383904 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:57.385207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fa582832-7899-4ca4-939f-e0a3ab1cc9e4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.232678 Sep 22 15:00:57.386297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 220/466] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:57 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:57.450203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-ece68236-ae7c-46ac-a3bb-084adc7a3176 req-e8e97fe7-9e84-42ee-9003-e0eae8a3f3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94107fe0-4109-4907-9e8c-2f48a0b6ea23", "tag": "90340433-4cf8-4079-bfef-08ee8c826ec0"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:57.460407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:57.461677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:57.464578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ece68236-ae7c-46ac-a3bb-084adc7a3176 req-e8e97fe7-9e84-42ee-9003-e0eae8a3f3fc service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:57.465240 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ece68236-ae7c-46ac-a3bb-084adc7a3176 req-e8e97fe7-9e84-42ee-9003-e0eae8a3f3fc service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:57.466167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ece68236-ae7c-46ac-a3bb-084adc7a3176 req-e8e97fe7-9e84-42ee-9003-e0eae8a3f3fc service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:57.485731 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-ece68236-ae7c-46ac-a3bb-084adc7a3176 req-e8e97fe7-9e84-42ee-9003-e0eae8a3f3fc service nova] Creating event network-changed:90340433-4cf8-4079-bfef-08ee8c826ec0 for instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 on hv-cinder-84456 Sep 22 15:00:57.492318 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-ece68236-ae7c-46ac-a3bb-084adc7a3176 req-e8e97fe7-9e84-42ee-9003-e0eae8a3f3fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045656 Sep 22 15:00:57.497525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 247/467] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:57.525221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:57.525842 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:57.538226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:57.538761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:57.539219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:57.543769 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:57.544475 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:57.545344 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:57.796005 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:57.809044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-29ab9031-35c7-48f9-96bf-a5dfded0ae35 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1370 microversion: 2.1 time: 0.288356 Sep 22 15:00:57.810841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 221/468] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:57 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:57.837969 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-b72bd668-a125-4601-881e-43f019dc8db8 req-9ef974a9-9615-4c64-b350-e2105c0476cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd72afb-0e38-47ae-a54e-2667b786a75b", "name": "network-vif-plugged", "status": "completed", "tag": "643356c5-34f7-492b-a963-cdc7638a5c5a"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:00:57.851285 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-b72bd668-a125-4601-881e-43f019dc8db8 req-9ef974a9-9615-4c64-b350-e2105c0476cc service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:57.852000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-b72bd668-a125-4601-881e-43f019dc8db8 req-9ef974a9-9615-4c64-b350-e2105c0476cc service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:57.852686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-b72bd668-a125-4601-881e-43f019dc8db8 req-9ef974a9-9615-4c64-b350-e2105c0476cc service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:57.857299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:00:57.884373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-b72bd668-a125-4601-881e-43f019dc8db8 req-9ef974a9-9615-4c64-b350-e2105c0476cc service nova] Creating event network-vif-plugged:643356c5-34f7-492b-a963-cdc7638a5c5a for instance 0cd72afb-0e38-47ae-a54e-2667b786a75b on hv-cinder-84456 Sep 22 15:00:57.902678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-b72bd668-a125-4601-881e-43f019dc8db8 req-9ef974a9-9615-4c64-b350-e2105c0476cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065856 Sep 22 15:00:57.902678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 248/469] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:00:58.416477 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:58.417402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:58.423188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:58.423910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:58.424552 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:58.425411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:58.426017 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:58.426607 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:58.630151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:58.643960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:58.646089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:58.648001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ce22409a-c49b-4022-91ce-d6f549995094 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.236150 Sep 22 15:00:58.662764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 222/470] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:58 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:00:58.833860 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:58.837373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:58.846413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:58.847176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:58.847763 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:58.848617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:58.849216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:58.849831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:59.037028 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:59.045442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9701cf82-16dc-45c1-9ed3-83304cbbbaba tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1370 microversion: 2.1 time: 0.215553 Sep 22 15:00:59.050942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 249/471] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:00:58 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:00:59.682350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:00:59.683178 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:00:59.689990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:59.690700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:59.691224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:59.692179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:00:59.692916 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:00:59.694257 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:00:59.845103 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:59.854323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:59.855813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:00:59.857335 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7461bde9-7ec2-4ae1-84a0-965ebc39531f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.179607 Sep 22 15:00:59.874298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 223/472] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:00:59 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:00.076001 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:00.077065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:00.085137 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:00.085974 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:00.086647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:00.087920 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:00.088855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:00.089510 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:00.260486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:00.269810 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fbd418a5-8c74-4534-8e86-ae4db263c458 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1563 microversion: 2.1 time: 0.197784 Sep 22 15:01:00.270397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 250/473] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:00 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:00.293862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:00.294640 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:00.301323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:00.302226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:00.302770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:00.303738 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:00.304228 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:00.304937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:00.393756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9cf3c15a-d926-4cc1-8c83-f231836484e0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104076 Sep 22 15:01:00.394390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 224/474] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 15:01:00 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:00.901235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:00.901857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:00.908302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:00.908964 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:00.909551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:00.910396 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:00.911274 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:00.911964 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:01.138475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:01.147970 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:01.149891 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:01.151108 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5cd8d09a-1c69-4cb2-8fb1-d88fd2d74552 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1740 microversion: 2.20 time: 0.253818 Sep 22 15:01:01.151672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 251/475] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:00 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:01.421078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-dd00fae8-0c44-4e1f-a67a-325289172e82 req-ae8e1dd6-7c53-4f00-a8d2-8bd955a9bd72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd72afb-0e38-47ae-a54e-2667b786a75b", "tag": "643356c5-34f7-492b-a963-cdc7638a5c5a"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:01.431249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dd00fae8-0c44-4e1f-a67a-325289172e82 req-ae8e1dd6-7c53-4f00-a8d2-8bd955a9bd72 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:01.432284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dd00fae8-0c44-4e1f-a67a-325289172e82 req-ae8e1dd6-7c53-4f00-a8d2-8bd955a9bd72 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:01.432284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dd00fae8-0c44-4e1f-a67a-325289172e82 req-ae8e1dd6-7c53-4f00-a8d2-8bd955a9bd72 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:01.444758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-dd00fae8-0c44-4e1f-a67a-325289172e82 req-ae8e1dd6-7c53-4f00-a8d2-8bd955a9bd72 service nova] Creating event network-changed:643356c5-34f7-492b-a963-cdc7638a5c5a for instance 0cd72afb-0e38-47ae-a54e-2667b786a75b on hv-cinder-84456 Sep 22 15:01:01.449801 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-dd00fae8-0c44-4e1f-a67a-325289172e82 req-ae8e1dd6-7c53-4f00-a8d2-8bd955a9bd72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032784 Sep 22 15:01:01.450400 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 225/476] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:02.176346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:02.176977 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:02.183950 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:02.184426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:02.184855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:02.185555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:02.186005 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:02.186420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:02.353759 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:02.363225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:02.365093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:02.367048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ceaca221-4d5d-4ecd-ad50-ba8f76ba2cf9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1722 microversion: 2.20 time: 0.194610 Sep 22 15:01:02.367639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 252/477] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:02 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:03.394405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:03.395141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:03.401595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:03.402077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:03.402511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:03.403251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:03.403703 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:03.404127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:03.547220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:03.554968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:03.559717 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:03.561465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:03.562670 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1f8d023c-ac88-4407-9ed1-476a1463f656 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1722 microversion: 2.20 time: 0.173045 Sep 22 15:01:03.563260 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 226/478] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:03 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:04.590243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:04.590843 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:04.597153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:04.597641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:04.598073 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:04.598809 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:04.599265 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:04.599692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:04.729681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:04.737791 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:04.739270 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:04.740421 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-84bfef09-8a61-4756-9583-c6f3e343c97a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1722 microversion: 2.20 time: 0.155457 Sep 22 15:01:04.740982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 253/479] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:04 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:05.765669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:05.766288 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:05.774516 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:05.775526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:05.775961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:05.776652 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:05.777104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:05.777530 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:05.909218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:05.917627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:05.919116 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:05.920309 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0a03a83c-ffa8-45cb-a454-1dfaf36406ae tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1722 microversion: 2.20 time: 0.158577 Sep 22 15:01:05.920880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 227/480] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:05 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:06.260438 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-40b9c0c5-abba-4485-bef3-5a94412286d8 req-8dbe6bb7-1fa0-4f7f-b6c2-2e00d4c98f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45e6623-9952-42a0-b01e-85001ae14fd2", "name": "network-vif-unplugged", "status": "completed", "tag": "ecbef20d-ee6a-4cae-8583-7ab49d776a37"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:06.270142 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-40b9c0c5-abba-4485-bef3-5a94412286d8 req-8dbe6bb7-1fa0-4f7f-b6c2-2e00d4c98f1d service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:06.270631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-40b9c0c5-abba-4485-bef3-5a94412286d8 req-8dbe6bb7-1fa0-4f7f-b6c2-2e00d4c98f1d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:06.271089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-40b9c0c5-abba-4485-bef3-5a94412286d8 req-8dbe6bb7-1fa0-4f7f-b6c2-2e00d4c98f1d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:06.282617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-40b9c0c5-abba-4485-bef3-5a94412286d8 req-8dbe6bb7-1fa0-4f7f-b6c2-2e00d4c98f1d service nova] Creating event network-vif-unplugged:ecbef20d-ee6a-4cae-8583-7ab49d776a37 for instance c45e6623-9952-42a0-b01e-85001ae14fd2 on hv-cinder-84456 Sep 22 15:01:06.287488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-40b9c0c5-abba-4485-bef3-5a94412286d8 req-8dbe6bb7-1fa0-4f7f-b6c2-2e00d4c98f1d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031314 Sep 22 15:01:06.288091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 254/481] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:06.945319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:06.945925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:06.952992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:06.952992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:06.953398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:06.954092 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:06.954543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:06.955183 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:07.092636 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:07.100691 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:07.102285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:07.104170 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c1cd7bf5-6b99-458a-a1cb-7214304301ba tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1722 microversion: 2.20 time: 0.162707 Sep 22 15:01:07.104743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 228/482] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:06 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:08.130332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:08.130976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:08.137193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.137675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.138112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:08.138991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.139449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.139882 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:08.268100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:08.276055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:08.277482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:08.278611 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-31e834e6-7a42-4659-a4dc-81e98fe572f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1725 microversion: 2.20 time: 0.152916 Sep 22 15:01:08.279200 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 255/483] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:08 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:08.303661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52ac1495-c87c-44ae-8e5e-223b9a216c74"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:08.306031 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:08.313429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.313908 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.314340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:08.315065 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.315526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.315947 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:08.604902 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9d4eec63-a476-4933-aaed-34cf8822d55d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305261 Sep 22 15:01:08.605548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 229/484] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Sep 22 15:01:08 2022] POST /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 15:01:08.730043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:08.730640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:08.736561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.737038 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.737466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:08.738926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.739757 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.739990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:08.785699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120694) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 15:01:08.852927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b4450895-b9a5-4767-9243-8430b0c29be5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/action" status: 202 len: 0 microversion: 2.20 time: 0.127450 Sep 22 15:01:08.857316 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 256/485] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 22 15:01:08 2022] POST /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:01:08.866358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:08.866584 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:08.873290 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.873781 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.874220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:08.874967 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:08.875422 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:08.875852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:09.013597 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:09.029209 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:09.030665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:09.031857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8b911206-cd22-4390-b0fa-14b145a87865 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1811 microversion: 2.20 time: 0.169868 Sep 22 15:01:09.032533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 230/486] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:08 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:10.058540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:10.059193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:10.065226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:10.065709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:10.066149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:10.066868 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:10.067329 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:10.067781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:10.204110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:10.213903 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:10.215586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:10.216770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-695699b5-b36b-4b23-95f0-73c1a70345f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1811 microversion: 2.20 time: 0.162930 Sep 22 15:01:10.217338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 257/487] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:10 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:11.244339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:11.245128 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:11.252626 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:11.253198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:11.253642 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:11.254338 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:11.254848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:11.255227 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:11.411495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:11.421226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:11.422972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:11.424344 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-aa7c0395-84ab-4fd5-91de-20341253ad60 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1751 microversion: 2.20 time: 0.183977 Sep 22 15:01:11.439405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 231/488] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:11 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:12.449830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:12.450374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:12.456224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:12.456687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:12.457129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:12.457814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:12.458266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:12.458691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:12.591640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:12.600381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:12.601880 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:12.603850 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-47350ef2-ab41-4761-98b7-7b54b49d42fc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1753 microversion: 2.20 time: 0.157179 Sep 22 15:01:12.604475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 258/489] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:12 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:13.629841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:13.630455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:13.636897 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:13.637386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:13.637824 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:13.638522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:13.639004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:13.639434 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:13.769653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:13.778717 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:13.780292 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:13.781444 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-927b50ec-7611-4fc0-a3a5-2f0248f6ba12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1753 microversion: 2.20 time: 0.155655 Sep 22 15:01:13.782000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 232/490] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:13 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:14.807069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:14.807676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:14.813568 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:14.814046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:14.814480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:14.815191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:14.815643 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:14.816064 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:14.945621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:14.954136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:14.955605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:14.956751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ddaf81be-4fba-4e25-9eb5-ea422334dd8b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1753 microversion: 2.20 time: 0.154088 Sep 22 15:01:14.957307 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 259/491] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:14 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:15.982059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:15.982674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:15.989084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:15.989565 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:15.990007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:15.990699 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:15.991180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:15.991603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:16.119329 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:16.127784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:16.129234 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:16.130393 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-323e8978-8f46-43ca-aa10-a4729a2bf5e9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1753 microversion: 2.20 time: 0.152304 Sep 22 15:01:16.131058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 233/492] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:15 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:17.156507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:17.157125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:17.163190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:17.163670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:17.164102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:17.165471 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:17.165829 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:17.166161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:17.297456 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:17.306717 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:17.308173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:17.309341 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-38d58a49-41ac-47fa-96f2-34218cc86ce2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.156874 Sep 22 15:01:17.309938 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 260/493] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:17 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:17.649023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:17.650060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:17.656590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:17.657067 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:17.657498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:17.658180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:17.658624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:17.659081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:17.682496 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d8e5969e-08ce-48dd-82ca-76dbb2c32605 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/ips" status: 200 len: 146 microversion: 2.1 time: 0.037262 Sep 22 15:01:17.683031 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 234/494] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:01:17 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:18.335303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:18.335912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:18.342826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:18.343305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:18.343746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:18.344435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:18.344888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:18.345308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:18.480753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:18.489806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:18.491713 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:18.493092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f2ac13ef-5128-4209-b97f-03e483d690ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.161766 Sep 22 15:01:18.494208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 261/495] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:18 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:19.520800 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:19.521411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:19.528148 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:19.528632 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:19.529340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:19.530032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:19.530479 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:19.530925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:19.682140 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:19.694009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:19.695502 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:19.696901 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c7a7d300-be5e-4064-8fd7-07609d86b99c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.180109 Sep 22 15:01:19.697456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 235/496] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:19 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:20.728049 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:20.729830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:20.736261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:20.736736 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:20.737211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:20.737907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:20.738352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:20.738793 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:20.821447 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:20.822113 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:20.830842 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:20.831555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:20.832164 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:20.832894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:20.833350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:20.833776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:20.889564 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:20.899370 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:20.900839 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:20.902422 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1824f91d-bea5-4dc0-9e46-60713ce212f2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.179612 Sep 22 15:01:20.910325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 262/497] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:20 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:20.969173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lazy-loading 'services' on Instance uuid c3e3e987-00d8-40fb-8460-893016f4831e {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:01:21.081142 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c95cdb7a-460d-4e9a-9281-13b2472280e9"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:21.083637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:21.090570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:21.091131 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:21.091526 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:21.092256 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:21.092682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:21.093100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:21.093350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cedf66e4-b267-40b8-8ad0-f641b22aefe2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e/os-volume_attachments/7a6fa043-586e-496e-bdeb-55628a135508" status: 202 len: 0 microversion: 2.1 time: 0.275862 Sep 22 15:01:21.093943 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 236/498] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:01:20 2022] DELETE /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e/os-volume_attachments/7a6fa043-586e-496e-bdeb-55628a135508 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 15:01:21.935316 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:21.936541 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:21.946837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:21.947649 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:21.948331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:21.950151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:21.951500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:21.952519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:22.088893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:22.097839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:22.099295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:22.100448 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-280e44a1-489a-497c-94e0-3ca13d0d73f9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.174394 Sep 22 15:01:22.100998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 237/499] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:21 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:23.126295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:23.127129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:23.133924 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:23.134799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:23.135305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:23.136092 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:23.136614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:23.137146 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:23.286307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:23.295835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:23.297310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:23.298481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c9419205-206b-401c-90ea-6825b9e9a4fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.176154 Sep 22 15:01:23.309728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 238/500] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:23 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:24.325069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:24.325674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:24.338857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:24.339620 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:24.343174 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:24.344167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:24.344807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:24.351133 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:24.713698 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:24.722934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:24.724377 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:24.725531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6ecdf012-47c0-493a-b3c9-ed721ff6ce18 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.404948 Sep 22 15:01:24.726084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 239/501] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:24 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:25.755847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:25.756520 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:25.764101 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:25.765839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:25.765839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:25.765839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:25.767840 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:25.767840 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:25.792826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:25.954247 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:25.963981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:25.965423 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:25.966576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-94a52d08-d08c-4420-8b8f-106f828ea48f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.215593 Sep 22 15:01:25.967165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 240/502] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:25 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:26.992390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:26.993080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:26.999856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:27.000358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:27.000786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:27.001855 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:27.002314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:27.002766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:27.157563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:27.167064 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:27.168615 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:27.169793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-267b863c-06ae-4f2d-ac34-09f72f5f4f6f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.181505 Sep 22 15:01:27.170582 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 241/503] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:26 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:28.196104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:28.196862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:28.199027 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=44 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:28.206772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:28.207258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:28.207765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:28.208495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:28.208942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:28.209364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:28.362446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:28.372794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:28.374698 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:28.376198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-41095a20-c912-4578-a822-8f68b6977e37 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.183967 Sep 22 15:01:28.376870 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 242/504] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:28 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:29.402601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:29.403350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:29.409637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:29.410114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:29.410550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:29.411288 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:29.411745 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:29.412241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:29.553482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:29.568388 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:29.570537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:29.572249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-01d1827c-b8db-4470-bda3-330bb22887a7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.173591 Sep 22 15:01:29.573289 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 243/505] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:29 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:30.602179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:30.603629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:30.610633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:30.611168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:30.611595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:30.612310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:30.612798 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:30.613215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:30.761247 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:30.775554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:30.777009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:30.778249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bafb74e2-f59c-419c-a778-e6b0c5ba0e90 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.180499 Sep 22 15:01:30.795195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 244/506] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:30 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:30.799161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:30.968143 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dde4a9c0-ac97-4896-ae7b-32f4cf967174 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.892291 Sep 22 15:01:30.974180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 263/507] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:01:21 2022] POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-volume_attachments => generated 194 bytes in 9894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:01:31.805610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:31.806219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:31.812669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:31.813156 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:31.813593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:31.814289 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:31.814754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:31.815189 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:31.948184 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:31.956682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:31.958121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:31.959320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-35bb045a-8b62-45d0-82f7-45e90f4efd81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.157638 Sep 22 15:01:31.959878 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 245/508] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:31 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:32.985486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:32.986200 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:32.988620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:32.994776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:32.995251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:32.995677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:32.996357 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:32.996800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:32.997214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:33.132240 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:33.141219 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:33.142715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:33.143909 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6e430732-87d1-464e-ae3e-fd4a53edc425 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.162668 Sep 22 15:01:33.144466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 264/509] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:32 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:34.168687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:34.169291 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:34.175583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:34.176061 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:34.176486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:34.177167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:34.177618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:34.178031 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:34.306464 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:34.317596 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:34.319073 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:34.320259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5935e627-528d-4478-b258-28439ef6ddce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.155403 Sep 22 15:01:34.320815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 246/510] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:34 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:35.345388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:35.345991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:35.352346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:35.352843 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:35.353274 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:35.353950 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:35.354394 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:35.354922 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:35.482830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:35.491234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:35.492666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:35.494338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d26c3cc3-e14f-4f32-b00e-fec4382bf512 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.152877 Sep 22 15:01:35.494915 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 265/511] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:35 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:36.520150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:36.520764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:36.527540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:36.528021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:36.528453 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:36.529142 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:36.529596 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:36.530021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:36.661776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:36.671007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:36.672462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:36.673613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-170d389d-8dd4-4e84-93d2-573b4c5aacfc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.157499 Sep 22 15:01:36.674176 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 247/512] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:36 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:37.700096 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:37.700707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:37.707122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:37.707605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:37.708039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:37.708725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:37.709173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:37.709594 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:37.840498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:37.849041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:37.850493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:37.851682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-12378e4a-0d84-4e9b-8d08-241dea4affa1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.156033 Sep 22 15:01:37.852645 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 266/513] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:37 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:38.880934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:38.881549 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:38.888760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:38.889253 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:38.889686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:38.890379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:38.890868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:38.891299 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:39.027411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:39.035999 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:39.037438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:39.038587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0f3ebfa6-3318-47ff-b3fa-1a6b153ad5a9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.161604 Sep 22 15:01:39.039180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 248/514] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:38 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:40.065894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:40.066484 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:40.073336 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:40.073822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:40.074271 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:40.075003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:40.075468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:40.075894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:40.225428 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:40.234707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:40.236190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:40.237347 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-93fd8d6d-d166-4ecc-8ffd-4ac42ff2e692 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.175876 Sep 22 15:01:40.237899 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 267/515] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:40 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:41.263086 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:41.263698 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:41.269846 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:41.270322 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:41.270776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:41.271465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:41.271916 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:41.272342 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:41.413400 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:41.422760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:41.424202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:41.425356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-75f1ae29-9b89-4f56-8b51-bf1a80414ce4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.166269 Sep 22 15:01:41.425909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 249/516] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:41 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:41.482082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:41.482591 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:41.489265 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:41.489741 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:41.490176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:41.490890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:41.491344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:41.491768 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:41.516046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Going to try to terminate instance {{(pid=120694) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:01:41.596214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ca5818b6-f70f-4eb0-8de2-0ba2a7180969 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 204 len: 0 microversion: 2.1 time: 0.118032 Sep 22 15:01:41.597045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 268/517] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:01:41 2022] DELETE /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 15:01:41.607630 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:41.608563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:41.615087 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:41.615577 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:41.616146 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:41.616723 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:41.617175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:41.617781 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:41.755012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:41.763064 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0c85cd8d-ecb4-41cf-80c7-84ca19b564f8 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1514 microversion: 2.1 time: 0.161581 Sep 22 15:01:41.763608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 250/518] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:41 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:01:42.452347 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:42.452965 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:42.458851 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:42.459334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:42.459766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:42.460451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:42.460898 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:42.461322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:42.477035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 15:01:42.477203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Thu Sep 22 15:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 (ip 10.222.0.26) !!! Sep 22 15:01:42.599838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:42.609074 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:42.610526 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:42.611718 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f0fe1527-3535-4196-8752-3cc63cda7d14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.163665 Sep 22 15:01:42.612278 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 269/519] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:42 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:42.786973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:42.787611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:42.795066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:42.795551 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:42.795985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:42.796680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:42.797135 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:42.797564 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:42.926029 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:42.934285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-35d67c66-3067-4eb2-b38f-9636705bd260 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1514 microversion: 2.1 time: 0.151229 Sep 22 15:01:42.934889 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 251/520] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:42 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:43.637795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:43.639146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:43.645589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:43.646069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:43.646498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:43.647230 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:43.647807 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:43.648229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:43.743667 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-77623f51-6b93-412e-ad07-07591abbe772 req-b1ed828d-2cd8-4488-bb95-76c318523169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45e6623-9952-42a0-b01e-85001ae14fd2", "name": "network-vif-plugged", "status": "completed", "tag": "ecbef20d-ee6a-4cae-8583-7ab49d776a37"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:43.762636 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77623f51-6b93-412e-ad07-07591abbe772 req-b1ed828d-2cd8-4488-bb95-76c318523169 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:43.763144 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77623f51-6b93-412e-ad07-07591abbe772 req-b1ed828d-2cd8-4488-bb95-76c318523169 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:43.763573 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77623f51-6b93-412e-ad07-07591abbe772 req-b1ed828d-2cd8-4488-bb95-76c318523169 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:43.793682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-77623f51-6b93-412e-ad07-07591abbe772 req-b1ed828d-2cd8-4488-bb95-76c318523169 service nova] Creating event network-vif-plugged:ecbef20d-ee6a-4cae-8583-7ab49d776a37 for instance c45e6623-9952-42a0-b01e-85001ae14fd2 on hv-cinder-84456 Sep 22 15:01:43.801229 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-77623f51-6b93-412e-ad07-07591abbe772 req-b1ed828d-2cd8-4488-bb95-76c318523169 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061860 Sep 22 15:01:43.802456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 252/521] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:01:43.847135 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:43.859158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:43.860966 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:43.862874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-efc2bd26-5b0e-4096-8a60-695e15a2882f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.229213 Sep 22 15:01:43.863868 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 270/522] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:43 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:43.920605 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-ba3617fd-6737-447e-8b4d-5f29209796dc req-81718c9f-dc45-42ca-9979-810bf6fa045c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e3e987-00d8-40fb-8460-893016f4831e", "name": "network-vif-deleted", "tag": "d8489e08-1ba1-4d97-9eba-70205d841cb9"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:43.930018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ba3617fd-6737-447e-8b4d-5f29209796dc req-81718c9f-dc45-42ca-9979-810bf6fa045c service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:43.930513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ba3617fd-6737-447e-8b4d-5f29209796dc req-81718c9f-dc45-42ca-9979-810bf6fa045c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:43.930985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-ba3617fd-6737-447e-8b4d-5f29209796dc req-81718c9f-dc45-42ca-9979-810bf6fa045c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:43.942109 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-ba3617fd-6737-447e-8b4d-5f29209796dc req-81718c9f-dc45-42ca-9979-810bf6fa045c service nova] Creating event network-vif-deleted:d8489e08-1ba1-4d97-9eba-70205d841cb9 for instance c3e3e987-00d8-40fb-8460-893016f4831e on hv-cinder-84456 Sep 22 15:01:43.947164 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-ba3617fd-6737-447e-8b4d-5f29209796dc req-81718c9f-dc45-42ca-9979-810bf6fa045c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 Sep 22 15:01:43.947761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 253/523] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:43.957316 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:43.957863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:43.964611 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:43.965086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:43.965518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:43.966199 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:43.966650 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:43.967096 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:44.027289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:44.035058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-62f73ab7-2504-4016-9466-08953ee443e0 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1472 microversion: 2.1 time: 0.081548 Sep 22 15:01:44.035621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 271/524] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:43 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:44.889827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:44.890457 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:44.897037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:44.897507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:44.897933 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:44.898609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:44.899680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:44.900114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:45.030097 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:45.038637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:45.040082 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:45.041215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0760a31d-bcac-48d7-97d9-1308b167046c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.155742 Sep 22 15:01:45.041761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 254/525] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:44 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:45.060049 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:45.060827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:45.067332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:45.067819 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:45.068257 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:45.068962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:45.069409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:45.069832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:45.103088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:45.103570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:45.104196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:45.104666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lazy-loading 'fault' on Instance uuid c3e3e987-00d8-40fb-8460-893016f4831e {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:01:45.149010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:45.157434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3c8c99c7-a922-4f5b-8c9e-97835a3a4c92 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 200 len: 1309 microversion: 2.1 time: 0.102275 Sep 22 15:01:45.165831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 272/526] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:45 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:46.065688 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:46.066274 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:46.072868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:46.073370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:46.073790 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:46.074477 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:46.074950 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:46.075370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:46.183260 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:46.184123 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: c3e3e987-00d8-40fb-8460-893016f4831e] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:46.191152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:46.191654 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:46.192152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:46.192894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:46.193510 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:46.194120 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:46.210061 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:46.213545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] HTTP exception thrown: Instance c3e3e987-00d8-40fb-8460-893016f4831e could not be found. Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Request method failure captured: Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e HTTP/1.1 Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHh6mAmWaDma-TZxvI8zwFANe0IlJ1gQVRUjFstZtOlGaxffpWvNYrAmaR5V9-nJkVU6duYOWUbTxUtEbMzfKr-JWgSipqK4UicgnY6DYo7i7WGON4IQhuA2MIJZaAIWCCThxhF1iDZYISdP1efwp5cM7a0f2WSNHZXaE6TiG6Z09VI Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 26875c24ce944501a6b23188c784d9f5 Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-VolumesSnapshotTestJSON-436352613 Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:01:46.215724 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26875c24ce944501a6b23188c784d9f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_26875c24ce944501a6b23188c784d9f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26875c24ce944501a6b23188c784d9f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/26875c24ce944501a6b23188c784d9f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-VolumesSnapshotTestJSON-436352613 Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 26875c24ce944501a6b23188c784d9f5 Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-436352613 Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-VolumesSnapshotTestJSON-436352613-project Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 8463811a630e4b90b1cd96e4dec020a2 Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-VolumesSnapshotTestJSON-436352613-project Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance c3e3e987-00d8-40fb-8460-893016f4831e could not be found. Sep 22 15:01:46.217348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'c3e3e987-00d8-40fb-8460-893016f4831e'} Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3e3e987-00d8-40fb-8460-893016f4831e could not be found. Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:01:46.218214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3e3e987-00d8-40fb-8460-893016f4831e could not be found. Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3e3e987-00d8-40fb-8460-893016f4831e could not be found. Sep 22 15:01:46.219490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:46.220780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Returning 404 to user: Instance c3e3e987-00d8-40fb-8460-893016f4831e could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:01:46.220780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4678205a-3184-4f8d-86f2-70944bc861d9 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e" status: 404 len: 111 microversion: 2.1 time: 0.039780 Sep 22 15:01:46.220780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 273/527] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:46 2022] GET /compute/v2.1/servers/c3e3e987-00d8-40fb-8460-893016f4831e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:01:46.228814 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:46.230255 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:46.231558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e0fc1e74-c063-4bb0-b7d7-b0b119c6eed3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.169563 Sep 22 15:01:46.232280 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 255/528] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:46 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:47.257192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:47.257812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:47.264285 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:47.264761 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:47.265195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:47.265886 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:47.266340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:47.266782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:47.394208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:47.402788 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:47.404217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:47.405355 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9c49f329-ab62-4a0c-9d57-19f732584e85 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.152093 Sep 22 15:01:47.405950 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 274/529] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:47 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:48.431948 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:48.432544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:48.438914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:48.439397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:48.439826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:48.440505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:48.440977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:48.441396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:48.508969 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faf8502c-c0e8-4330-a969-1ecb5845c941"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:48.511684 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:48.518142 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:48.518704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:48.519239 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:48.520027 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:48.520547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:48.521062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:48.578357 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:48.587059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:48.588906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:48.591358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f17446d6-f643-4072-8b5b-ea1b44a0bb77 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1809 microversion: 2.20 time: 0.163741 Sep 22 15:01:48.592035 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 256/530] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:48 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:01:49.617792 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:49.618772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:49.628203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:49.628695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:49.629134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:49.629847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:49.630435 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:49.630721 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:49.771095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:49.780325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:49.781810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:49.783082 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-692bbc7d-dc46-4e4d-8e26-38906b5433f1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1796 microversion: 2.20 time: 0.169244 Sep 22 15:01:49.783655 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 257/531] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:01:49 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1796 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:01:49.934246 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-09829693-d26c-44e8-901f-4818caa7c2aa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.429619 Sep 22 15:01:49.934977 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 275/532] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:01:48 2022] POST /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments => generated 194 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:01:50.217032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7378f407-ff47-4009-bc83-ecf9e2c93a5d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:50.222995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7378f407-ff47-4009-bc83-ecf9e2c93a5d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:50.223486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7378f407-ff47-4009-bc83-ecf9e2c93a5d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:50.223917 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7378f407-ff47-4009-bc83-ecf9e2c93a5d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:50.276624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=100 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:50.283486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7378f407-ff47-4009-bc83-ecf9e2c93a5d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Going to try to stop instance {{(pid=120695) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 15:01:50.327339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7378f407-ff47-4009-bc83-ecf9e2c93a5d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action" status: 202 len: 0 microversion: 2.1 time: 0.114073 Sep 22 15:01:50.328034 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 258/533] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:01:50 2022] POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:01:50.339059 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:50.340025 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:50.346658 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:50.347179 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:50.347608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:50.348442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:50.349063 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:50.349480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:50.487625 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:50.489911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:50.498165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-66970382-3b54-4004-9238-2e6127d0dbbf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.164531 Sep 22 15:01:50.498760 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 276/534] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:50 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:51.521686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:51.522375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:51.528537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:51.529015 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:51.529475 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:51.530161 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:51.530609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:51.531070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:51.664127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:51.672816 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9673aa6f-0dc7-48ea-8501-55ac038cbf3a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.155946 Sep 22 15:01:51.673374 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 259/535] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:51 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:52.698208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:52.698765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:52.705637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:52.706120 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:52.706558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:52.707277 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:52.707731 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:52.708163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:52.835777 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:52.844245 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-701ddfcd-f6db-4cae-a427-e67956afcb3c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.150928 Sep 22 15:01:52.844800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 277/536] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:52 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:53.002584 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:53.003126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:53.010282 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.010780 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.011219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.011910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.012363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.012793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.035630 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d5a0aa27-7d6b-436c-a3ed-e3de2b699a97 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23/ips" status: 200 len: 151 microversion: 2.1 time: 0.038230 Sep 22 15:01:53.036207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 260/537] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:01:52 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:53.048389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cc37425-e9ca-4f34-9a1b-9b430ba90726"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:53.051518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:53.058481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.058992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.059430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.060127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.060575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.061031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.141447 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Invalid volume: volume 3cc37425-e9ca-4f34-9a1b-9b430ba90726 is already attached to instances: fd5971c6-d2d8-4674-a079-4a4856e13fb6 Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: POST /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23/os-volume_attachments HTTP/1.1 Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 74 Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:01:53.143263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {"volumeAttachment": {"volumeId": "3cc37425-e9ca-4f34-9a1b-9b430ba90726"}} Sep 22 15:01:53.144562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Invalid volume: volume 3cc37425-e9ca-4f34-9a1b-9b430ba90726 is already attached to instances: fd5971c6-d2d8-4674-a079-4a4856e13fb6 Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'server_id': '94107fe0-4109-4907-9e8c-2f48a0b6ea23', 'body': {'volumeAttachment': {'volumeId': '3cc37425-e9ca-4f34-9a1b-9b430ba90726'}}} Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3cc37425-e9ca-4f34-9a1b-9b430ba90726 is already attached to instances: fd5971c6-d2d8-4674-a079-4a4856e13fb6 Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:53.145337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3cc37425-e9ca-4f34-9a1b-9b430ba90726 is already attached to instances: fd5971c6-d2d8-4674-a079-4a4856e13fb6 Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:53.146622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3cc37425-e9ca-4f34-9a1b-9b430ba90726 is already attached to instances: fd5971c6-d2d8-4674-a079-4a4856e13fb6 Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 400 to user: Invalid volume: volume 3cc37425-e9ca-4f34-9a1b-9b430ba90726 is already attached to instances: fd5971c6-d2d8-4674-a079-4a4856e13fb6 {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3ec80770-8011-4c8a-b356-d707b564ca81 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100701 Sep 22 15:01:53.148039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 278/538] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:01:53 2022] POST /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:01:53.154099 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:53.154648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:53.160588 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.161055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.161493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.162177 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.162631 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.163073 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.191557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:01:53.264837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bf372a1c-4e42-40b9-9b4e-b2509b11fe64 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 204 len: 0 microversion: 2.1 time: 0.114368 Sep 22 15:01:53.265571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 261/539] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:01:53 2022] DELETE /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:01:53.273974 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:53.274576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:53.280551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.281031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.281466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.282155 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.282607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.283056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.416288 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:53.423962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d64f5f21-90fb-4dcf-8c9f-b68551a88809 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1684 microversion: 2.1 time: 0.153828 Sep 22 15:01:53.424515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 279/540] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:53 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:53.868404 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:53.869102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:53.875055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.875542 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.875979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:53.876664 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:53.877119 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:53.877546 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:54.015802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:54.024885 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6c300ba1-c26d-4bd2-b97c-a95cb2588e3e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.160614 Sep 22 15:01:54.025458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 262/541] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:53 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:54.108610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-396150999", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "networks": [{"uuid": "27e826c9-62b2-4387-99ab-396d01e4e4f6"}]}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:54.162548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] validate_networks() for [('27e826c9-62b2-4387-99ab-396d01e4e4f6', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:01:54.449383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:54.450100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:54.456110 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:54.456665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:54.457159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:54.457931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:54.458446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:54.458896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:54.549953 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:01:54.550409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:01:54.550930 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:01:54.551342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:01:54.551755 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:01:54.561194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:54.561700 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:54.562137 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:54.562897 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:54.563350 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:54.563778 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:54.581151 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Getting quotas for project 26875c24ce944501a6b23188c784d9f5. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:01:54.585279 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Getting quotas for user 8463811a630e4b90b1cd96e4dec020a2 and project 26875c24ce944501a6b23188c784d9f5. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:01:54.597733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:01:54.600120 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:01:54.615123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:54.623571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3e3199e1-4ba1-49e2-8601-a1835a9ffd87 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1684 microversion: 2.1 time: 0.178658 Sep 22 15:01:54.624141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 263/542] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:54 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:01:54.648103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cdd16e9c-0ca8-47ab-90e8-db46066d2a27 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543232 Sep 22 15:01:54.649010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 280/543] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:01:54.660001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ce8f3f56-d3a6-4ff5-9e85-af023b1b8a5e tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:54.660621 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ce8f3f56-d3a6-4ff5-9e85-af023b1b8a5e tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:54.720937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ce8f3f56-d3a6-4ff5-9e85-af023b1b8a5e tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:54.731611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ce8f3f56-d3a6-4ff5-9e85-af023b1b8a5e tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1218 microversion: 2.1 time: 0.074412 Sep 22 15:01:54.732258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 264/544] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:54 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:55.048789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:55.049465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:55.056334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:55.058010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:55.059029 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:55.060201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:55.060665 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:55.061390 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:55.205445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:55.214605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cd127aeb-3b97-404d-873c-760341348385 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.170007 Sep 22 15:01:55.215193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 281/545] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:55 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:55.647034 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:55.647751 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:55.655746 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:55.656441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:55.657158 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:55.657864 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:55.658314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:55.658761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:55.756121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:55.756737 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:55.763263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:55.763752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:55.764191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:55.764894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:55.765354 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:55.765782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:55.792771 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:55.800885 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1b3f2984-9ec8-4b30-84f4-7dd89df9e25f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1684 microversion: 2.1 time: 0.158089 Sep 22 15:01:55.801618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 265/546] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:55 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:55.828243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:55.836176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-75925c00-9a11-4b64-9600-c90663a651f2 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1270 microversion: 2.1 time: 0.084021 Sep 22 15:01:55.836744 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 282/547] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:55 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:01:56.239458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:56.240121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:56.246524 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:56.247050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:56.247481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:56.248208 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:56.248637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:56.249162 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:56.410867 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:56.433156 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-28f1444d-833d-44d7-b391-c0b90cea425b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.197652 Sep 22 15:01:56.435709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 266/548] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:56 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:56.656356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-96dccd9c-7896-4c7e-8940-a9f2b690bd39 req-d1d401b7-913f-403d-b005-11ef105eac92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94107fe0-4109-4907-9e8c-2f48a0b6ea23", "name": "network-vif-deleted", "tag": "90340433-4cf8-4079-bfef-08ee8c826ec0"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:56.668086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-96dccd9c-7896-4c7e-8940-a9f2b690bd39 req-d1d401b7-913f-403d-b005-11ef105eac92 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:56.668569 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-96dccd9c-7896-4c7e-8940-a9f2b690bd39 req-d1d401b7-913f-403d-b005-11ef105eac92 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:56.668998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-96dccd9c-7896-4c7e-8940-a9f2b690bd39 req-d1d401b7-913f-403d-b005-11ef105eac92 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:56.680500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-96dccd9c-7896-4c7e-8940-a9f2b690bd39 req-d1d401b7-913f-403d-b005-11ef105eac92 service nova] Creating event network-vif-deleted:90340433-4cf8-4079-bfef-08ee8c826ec0 for instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 on hv-cinder-84456 Sep 22 15:01:56.685530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-96dccd9c-7896-4c7e-8940-a9f2b690bd39 req-d1d401b7-913f-403d-b005-11ef105eac92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032925 Sep 22 15:01:56.686068 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 283/549] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:56.826010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:56.826775 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:56.844002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:56.846300 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:56.847867 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:56.849863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:56.850725 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:56.852583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:56.860626 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:56.861764 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:56.869323 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:56.870326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:56.871135 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:56.872248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:56.873108 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:56.873769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:57.010778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:57.013519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:57.020123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9a9787c8-65b1-4547-9de7-fd35ccac9cab tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 200 len: 1327 microversion: 2.1 time: 0.197572 Sep 22 15:01:57.021372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 267/550] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:56 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 1327 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:57.024795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7e639629-5e78-429e-987c-1da5cd2a434c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1270 microversion: 2.1 time: 0.168884 Sep 22 15:01:57.025838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 284/551] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:56 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:57.460551 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:57.461224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:57.471802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:57.472303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:57.475758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:57.476746 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:57.478626 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:57.479603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:57.562566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:57.565034 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:57.579063 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:57.579559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:57.579995 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:57.580703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:57.581156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:57.581578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:57.617923 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lazy-loading 'flavor' on Instance uuid 0cd72afb-0e38-47ae-a54e-2667b786a75b {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:01:57.656246 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:57.664960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1ec8f3c1-9334-4674-b819-3b76baa98514 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.209023 Sep 22 15:01:57.666935 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 268/552] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:57 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:57.839596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7bfd7df9-3053-4952-a738-592fe76bebaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/action" status: 200 len: 32 microversion: 2.1 time: 0.280828 Sep 22 15:01:57.847561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 285/553] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:01:57 2022] POST /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/action => generated 32 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 15:01:57.855372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:57.856785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:57.869021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:57.869981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:57.870492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:57.872428 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:57.873106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:57.873726 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:58.047236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:58.048299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:58.064439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:58.065412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:58.067085 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:58.068096 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:58.068784 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:58.069429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:58.087997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 HTTP/1.1 Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:01:58.090769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:01:58.092191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '94107fe0-4109-4907-9e8c-2f48a0b6ea23'} Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:01:58.092910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:01:58.094127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:01:58.097056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:01:58.098156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ca8d91c5-ea43-4cc2-a040-55ab1369a0b5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 404 len: 111 microversion: 2.1 time: 0.056185 Sep 22 15:01:58.099362 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 286/554] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:58 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:01:58.105815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:58.107099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:58.109107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:58.117923 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:58.119131 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:58.119256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c7a3c3e7-ed24-43e4-8f59-77ff4c2b6d05 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.268434 Sep 22 15:01:58.135257 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 269/555] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:57 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:01:58.135257 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6c3bd506-8c2c-4d63-9789-4070d4321efa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '.version_select at 0x7f77e62dd8b0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:58.136475 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:58.137544 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:58.138239 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:58.138687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:58.169835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6c3bd506-8c2c-4d63-9789-4070d4321efa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739853075" status: 202 len: 0 microversion: 2.1 time: 0.048143 Sep 22 15:01:58.174923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 270/556] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 22 15:01:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1739853075 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:01:58.337055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:58.345482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-04368425-9d96-43dd-8cc9-b7fc4d38d0f6 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1318 microversion: 2.1 time: 0.244535 Sep 22 15:01:58.349048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 287/557] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:58 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:58.692126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:58.693018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:58.703980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:01:58.707437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:58.708875 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:58.709683 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:58.711562 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:58.712965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:58.713736 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:58.943215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:58.957942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5c5822b6-4fd7-4db4-82a2-0fb2c412e5b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.272362 Sep 22 15:01:58.959603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 271/558] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:58 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:59.142874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:59.143640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:59.151302 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:59.151462 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.151988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:59.152086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.152547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.153322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.153847 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.154371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.158712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.159437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.160037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.160775 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.161211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.161626 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.246043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lazy-loading 'services' on Instance uuid fd5971c6-d2d8-4674-a079-4a4856e13fb6 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:01:59.302247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:59.312395 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f393a1e7-8f08-4d87-b2bb-6832a04a125e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.173183 Sep 22 15:01:59.323232 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 288/559] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:59 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:59.337472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-3b9ebfeb-362b-46e2-a9ea-2daa10535862 req-55662b06-486d-456b-be2b-3ee2931d4aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330710ad-243c-419d-ab05-f4a5321236a4", "tag": "76b7e785-cd68-4fa5-bc5f-520d82726178"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:01:59.348504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3b9ebfeb-362b-46e2-a9ea-2daa10535862 req-55662b06-486d-456b-be2b-3ee2931d4aa3 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.349704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3b9ebfeb-362b-46e2-a9ea-2daa10535862 req-55662b06-486d-456b-be2b-3ee2931d4aa3 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.350696 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3b9ebfeb-362b-46e2-a9ea-2daa10535862 req-55662b06-486d-456b-be2b-3ee2931d4aa3 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.366983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-3b9ebfeb-362b-46e2-a9ea-2daa10535862 req-55662b06-486d-456b-be2b-3ee2931d4aa3 service nova] Creating event network-changed:76b7e785-cd68-4fa5-bc5f-520d82726178 for instance 330710ad-243c-419d-ab05-f4a5321236a4 on hv-cinder-84456 Sep 22 15:01:59.367961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79f6ebd1-35cc-4b63-acf1-78f5fb43a840 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments/3cc37425-e9ca-4f34-9a1b-9b430ba90726" status: 202 len: 0 microversion: 2.1 time: 0.221438 Sep 22 15:01:59.369269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 272/560] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:01:59 2022] DELETE /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments/3cc37425-e9ca-4f34-9a1b-9b430ba90726 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 15:01:59.375222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-3b9ebfeb-362b-46e2-a9ea-2daa10535862 req-55662b06-486d-456b-be2b-3ee2931d4aa3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042825 Sep 22 15:01:59.375755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:59.376636 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:59.377048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 289/561] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:59.383955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:59.384779 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.385436 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.385920 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.386828 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.387662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.388219 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:59.388398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.396811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.397522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.398105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.399743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.400333 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.401014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.436605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1403147d-4b35-4295-bc2d-bd962e40ae03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058256 Sep 22 15:01:59.437172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 290/562] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:01:59 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:01:59.548441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:01:59.556569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-37e31fd1-0a79-4c68-876b-d636149b0988 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1318 microversion: 2.1 time: 0.185944 Sep 22 15:01:59.557133 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 273/563] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:59 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:01:59.982885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:01:59.983797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:01:59.989743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.990231 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.990661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:01:59.991385 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:01:59.991829 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:01:59.993019 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:00.130480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:00.138959 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b8ceb875-50fe-482a-9d01-26d03c9b2d34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.159920 Sep 22 15:02:00.139772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 291/564] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:01:59 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:00.339739 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:00.340354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:00.347226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:00.347713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:00.348151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:00.348848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:00.349332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:00.349758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:00.354677 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:00.448502 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:00.450618 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:00.456914 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:00.457388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:00.457815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:00.458501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:00.458978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:00.459389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:00.482610 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:00.490950 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e3dd1c08-0833-45ae-9814-446e74be2405 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.155846 Sep 22 15:02:00.491229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-088c32cf-e27d-4d62-91f9-a892a84d9d28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046588 Sep 22 15:02:00.491518 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 274/565] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:00 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:00.491961 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 292/566] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:02:00 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:02:00.579439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:00.580042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:00.586590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:00.587104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:00.587822 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:00.588508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:00.588986 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:00.589403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:00.716813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:00.724429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-41dd9a1c-2def-4aec-b0d2-77ebe6f1a893 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1318 microversion: 2.1 time: 0.148882 Sep 22 15:02:00.724999 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 275/567] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:00 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:01.162203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:01.162871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:01.169729 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.170213 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.170647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.171365 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.171816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.172243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.311378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:01.320207 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8b4034c7-4811-494e-8154-cca1fc8c27dd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.162010 Sep 22 15:02:01.320871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 293/568] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:01 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:01.503749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:01.505987 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:01.512740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.513233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.513673 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.514379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.514485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:01.514953 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.515161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:01.515273 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.522465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.523000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.523435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.524332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.524794 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.525216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.529998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:01.548548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bb8ed491-8e54-4a8f-af3d-ea49c68e0a2e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048599 Sep 22 15:02:01.549370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 276/569] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:02:01 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 15:02:01.629903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:01.630399 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:01.636540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.637020 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.637452 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.638144 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.638589 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.639213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.667197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:02:01.668479 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:01.677023 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2616f1a6-402d-4c29-9ba3-454437af1049 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.166305 Sep 22 15:02:01.677757 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 294/570] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:01 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:01.748534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:01.749271 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:01.753675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9b8ae1a4-d1eb-45f7-bb16-f0d74d2c44df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 204 len: 0 microversion: 2.1 time: 0.125824 Sep 22 15:02:01.758617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.759088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.759396 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.759784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 277/571] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:02:01 2022] DELETE /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 15:02:01.762185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.762185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.762185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.770503 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:01.771536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:01.778246 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.778957 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.779565 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.780714 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:01.781176 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:01.781600 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:01.975559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:01.983437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:01.984561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a55ed22d-9688-443a-ba57-af2a730b4a36 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1318 microversion: 2.1 time: 0.240526 Sep 22 15:02:01.985147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 295/572] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:01 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:01.991269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fcebd720-f235-44a7-95d0-5c611cd3aa9a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1680 microversion: 2.1 time: 0.227435 Sep 22 15:02:01.991832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 278/573] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:01 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:02.343957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:02.344670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:02.350556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:02.351070 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:02.351505 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:02.352201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:02.352725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:02.353168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:02.479341 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:02.487409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-65b0bbdc-a058-4397-8dca-5f3fb7539998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.147323 Sep 22 15:02:02.487979 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 296/574] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:02 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:02.701462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:02.702064 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:02.708563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:02.709050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:02.709484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:02.710175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:02.710631 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:02.711161 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:02.842550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:02.850850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-272eb897-e399-47d7-b223-08841b8b0171 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.153208 Sep 22 15:02:02.851414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 279/575] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:02 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:03.007641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:03.008187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:03.011018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:03.015253 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:03.015866 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:03.016292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.016766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.017195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.017885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.018327 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.018756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.022150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.022644 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.023262 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.023969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.025224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.025846 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.211295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:03.218336 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:03.219170 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d0e3d4c5-343b-489b-8d83-0b28af84b57c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1318 microversion: 2.1 time: 0.215461 Sep 22 15:02:03.219742 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 297/576] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:03 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:03.226109 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8e5a83a8-a883-4a55-82f7-c24b37681b83 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1680 microversion: 2.1 time: 0.215149 Sep 22 15:02:03.226674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 280/577] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:03 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:03.511331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:03.511944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:03.517886 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.518367 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.518838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.519542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.519993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.520419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.649177 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:03.657534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3e017169-27aa-423f-bb84-37a3e895d681 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.150850 Sep 22 15:02:03.658192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 298/578] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:03 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:03.850325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-034e741c-223c-417e-85a0-be99099347d1 req-829510a1-2099-48b6-b20b-14bcceeacb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330710ad-243c-419d-ab05-f4a5321236a4", "name": "network-vif-plugged", "status": "completed", "tag": "76b7e785-cd68-4fa5-bc5f-520d82726178"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:03.864326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-034e741c-223c-417e-85a0-be99099347d1 req-829510a1-2099-48b6-b20b-14bcceeacb1e service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.864947 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-034e741c-223c-417e-85a0-be99099347d1 req-829510a1-2099-48b6-b20b-14bcceeacb1e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.865451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-034e741c-223c-417e-85a0-be99099347d1 req-829510a1-2099-48b6-b20b-14bcceeacb1e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.877716 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:03.878480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:03.878721 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-034e741c-223c-417e-85a0-be99099347d1 req-829510a1-2099-48b6-b20b-14bcceeacb1e service nova] Creating event network-vif-plugged:76b7e785-cd68-4fa5-bc5f-520d82726178 for instance 330710ad-243c-419d-ab05-f4a5321236a4 on hv-cinder-84456 Sep 22 15:02:03.886778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-034e741c-223c-417e-85a0-be99099347d1 req-829510a1-2099-48b6-b20b-14bcceeacb1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039836 Sep 22 15:02:03.887763 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 281/579] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:03.891578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.892137 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.893167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:03.893907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:03.895817 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:03.895817 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.043482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:04.052384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-23da4eaf-dfe1-40c1-9e59-a0b671080839 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.182229 Sep 22 15:02:04.052958 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 299/580] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:03 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:04.242902 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:04.246012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:04.252935 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:04.253426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:04.253861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.254573 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:04.254891 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:04.255114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:04.255485 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.255651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:04.263337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:04.263337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:04.263337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.264129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:04.264809 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:04.265314 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.362848 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:04.370863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-13cee391-e985-44f9-bf9b-a5a5c74cd5df tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1613 microversion: 2.1 time: 0.124711 Sep 22 15:02:04.382758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 300/581] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:04 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:04.431575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:04.439783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79d072dc-c860-4b5a-95a5-1118acdc34ef tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1318 microversion: 2.1 time: 0.201474 Sep 22 15:02:04.440375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 282/582] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:04 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:04.686051 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:04.687780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:04.698433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:04.699979 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=6 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:04.703060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:04.704311 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:04.705351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.706649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:04.707732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:04.708483 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.804938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-95c2ef98-9ad8-4868-b8ce-74ce5034e5de req-0f8c9ef4-ff54-4956-a218-93cb3343cc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5971c6-d2d8-4674-a079-4a4856e13fb6", "name": "network-vif-deleted", "tag": "331bff57-f783-4dec-bed0-6844457674e1"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:04.810880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:04.824909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-95c2ef98-9ad8-4868-b8ce-74ce5034e5de req-0f8c9ef4-ff54-4956-a218-93cb3343cc10 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:04.825618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-95c2ef98-9ad8-4868-b8ce-74ce5034e5de req-0f8c9ef4-ff54-4956-a218-93cb3343cc10 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:04.826128 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-95c2ef98-9ad8-4868-b8ce-74ce5034e5de req-0f8c9ef4-ff54-4956-a218-93cb3343cc10 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:04.838371 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-95c2ef98-9ad8-4868-b8ce-74ce5034e5de req-0f8c9ef4-ff54-4956-a218-93cb3343cc10 service nova] Creating event network-vif-deleted:331bff57-f783-4dec-bed0-6844457674e1 for instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 on hv-cinder-84456 Sep 22 15:02:04.843775 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-95c2ef98-9ad8-4868-b8ce-74ce5034e5de req-0f8c9ef4-ff54-4956-a218-93cb3343cc10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042616 Sep 22 15:02:04.844413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 283/583] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:02:04.888907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:04.897319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f1122720-64c1-476f-a6bc-51439de3dcdf tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.219679 Sep 22 15:02:04.897817 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 301/584] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:04 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:05.082461 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:05.084099 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:05.094937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.095741 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.096367 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.097278 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.098222 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.098848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.235978 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:05.244854 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9df07365-b3e5-4933-a28a-419f33d2d1d9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.169918 Sep 22 15:02:05.245790 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 284/585] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:05 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:05.395621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:05.396230 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:05.404504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.404907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.405338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.406026 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.406472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.406932 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.438571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.439091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.439526 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.439975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lazy-loading 'fault' on Instance uuid fd5971c6-d2d8-4674-a079-4a4856e13fb6 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:05.464270 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:05.465168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:05.471742 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.473098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.473736 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.474807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.475456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.476071 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.481675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:05.489956 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bafa516b-a442-448c-be9f-52975ff774a3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1330 microversion: 2.1 time: 0.098098 Sep 22 15:02:05.490832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 302/586] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:05 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:05.614310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:05.622756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5f021f7e-bf6b-45d4-87d9-cefacb05e17d tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1318 microversion: 2.1 time: 0.162928 Sep 22 15:02:05.623389 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 285/587] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:05 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:05.921378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:05.922046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:05.928164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.928655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.929103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:05.929834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:05.930291 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:05.931300 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.067646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:06.076110 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f1a41983-7b6d-4ee4-b3c2-057abb6342d6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.158777 Sep 22 15:02:06.076675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 303/588] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:05 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:06.269176 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:06.269742 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:06.276711 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.277191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.277627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.278312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.278790 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.279216 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.408586 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:06.417435 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7ede3ec9-0295-4b58-b7bc-e581c9e856c2 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.152237 Sep 22 15:02:06.418030 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 286/589] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:06 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:06.513365 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:06.513976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:06.520962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.521501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.521980 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.522689 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.523176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.523685 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.560849 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.561338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.561804 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.562260 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lazy-loading 'fault' on Instance uuid fd5971c6-d2d8-4674-a079-4a4856e13fb6 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:06.605819 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:06.612961 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-94137121-8be6-4a87-b37c-288a589a7d1c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 200 len: 1330 microversion: 2.1 time: 0.103514 Sep 22 15:02:06.613523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 304/590] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:06 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:06.645713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:06.646368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:06.652938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.653426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.653856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.654545 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.655030 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.655455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.782980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:06.790670 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6580b275-9f6f-4ff2-b5f8-2007e3f1fafa tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1507 microversion: 2.1 time: 0.148924 Sep 22 15:02:06.791266 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 287/591] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:06 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:06.812952 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9b0d290-ae5c-4dd6-9645-b50ef0019189", "device": "/dev/sdb"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:06.815896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:06.822266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.822748 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.823199 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:06.823878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:06.824328 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:06.824746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:07.083253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4a9c8d5b-094b-4315-b4b1-1eaf8b6d4905 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "POST /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274035 Sep 22 15:02:07.083875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 305/592] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:02:06 2022] POST /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:07.100182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:07.101001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:07.107227 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:07.107920 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:07.108355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:07.109058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:07.109511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:07.109937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:07.242251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:07.251418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-75f97e28-d8eb-41ae-8e23-a985151585d2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.155477 Sep 22 15:02:07.252207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 288/593] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:07 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:07.442289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:07.443034 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:07.449646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:07.450133 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:07.450570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:07.451299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:07.451752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:07.452178 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:07.583228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:07.592787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4f269490-67e9-4369-9993-ecd1c996d551 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.155229 Sep 22 15:02:07.593416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 306/594] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:07 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:07.635559 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:07.636182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:07.642660 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:07.643177 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:07.643613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:07.644316 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:07.644771 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:07.645199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:07.659368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 HTTP/1.1 Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:02:07.660993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:02:07.662531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'fd5971c6-d2d8-4674-a079-4a4856e13fb6'} Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:02:07.663521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:02:07.664998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:07.666426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:02:07.666426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f589637c-6b01-4934-938f-005a6aea714c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 404 len: 111 microversion: 2.1 time: 0.031171 Sep 22 15:02:07.666426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 289/595] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:07 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:02:07.671222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-638d4019-7771-4198-b474-678b466c04aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '.version_select at 0x7f77e63689d0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:07.694274 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-638d4019-7771-4198-b474-678b466c04aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481126033" status: 202 len: 0 microversion: 2.1 time: 0.026819 Sep 22 15:02:07.694952 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 307/596] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 22 15:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481126033 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:02:08.275271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:08.275915 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:08.281820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:08.282313 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:08.282767 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:08.283471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:08.283930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:08.284355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:08.460369 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:08.469255 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-51242223-5f14-47b0-b7dd-fe905a7d0620 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.198500 Sep 22 15:02:08.469832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 290/597] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:08 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:08.597355 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2e9f56cd-e048-47ac-ae39-cf3288aa6972 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: .version_select at 0x7f77e6352700>, body: {"keypair": {"name": "tempest-keypair-2095460558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMro52RiQe40bd9Rr+rw+nPWrZbPTTIAe75HVNwG+3afuzj71yqyoDcyVhijxw6COqRzOomnthoLf/weBL/Z3fga1PTvOe1EVSuYK/Eu2U7y0HeusgC+w7TcO0mxoZ7rPg=="}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:08.613946 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-2e9f56cd-e048-47ac-ae39-cf3288aa6972 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:02:08.617959 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:08.618181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-2e9f56cd-e048-47ac-ae39-cf3288aa6972 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:02:08.618831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:08.625323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:08.625808 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:08.626252 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:08.626978 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:08.627435 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:08.627873 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:08.632633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:08.640944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2e9f56cd-e048-47ac-ae39-cf3288aa6972 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047996 Sep 22 15:02:08.641935 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 308/598] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:02:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:08.812786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:08.820907 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-960f47f5-5c1e-4afc-83cd-d881b9823b45 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.207867 Sep 22 15:02:08.821953 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 291/599] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:08 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:09.495070 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:09.495692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:09.501673 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:09.502156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:09.502594 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:09.503326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:09.503777 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:09.504203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:09.636666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:09.644851 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3a77da1a-c394-4a95-a201-22e20564800e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.154329 Sep 22 15:02:09.645420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 309/600] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:09 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:09.845432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:09.846069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:09.852608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:09.853105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:09.853546 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:09.854258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:09.854740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:09.855173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:09.995346 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:10.004333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c11f4fe5-4746-4431-b823-90ae3f191df4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.162801 Sep 22 15:02:10.004894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 292/601] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:09 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:10.026212 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-269298186", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff6bd501-2fb8-4ba1-b730-2cab6c908602"}], "security_groups": [{"name": "tempest-securitygroup--984056368"}], "key_name": "tempest-keypair-2095460558", "user_data": "}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:10.135550 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] validate_networks() for [('ff6bd501-2fb8-4ba1-b730-2cab6c908602', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:02:10.508125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:02:10.508547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:02:10.509018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:02:10.509447 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:02:10.509856 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:02:10.518629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:10.519133 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:10.519566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:10.520283 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:10.520732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:10.521154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:10.537477 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:02:10.541814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:02:10.552739 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:02:10.555054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:02:10.602843 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c78fe8f8-6fa6-40e5-8d18-1a9d8dd39a29 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.581543 Sep 22 15:02:10.603500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 310/602] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:02:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 15:02:10.614576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0d8426ad-714c-4ae3-9543-143f01896dc9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:10.615221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0d8426ad-714c-4ae3-9543-143f01896dc9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:10.668229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:10.668866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:10.676000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:10.677462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d8426ad-714c-4ae3-9543-143f01896dc9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:10.677597 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:10.677992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:10.678857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:10.679206 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:10.679644 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:10.685862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0d8426ad-714c-4ae3-9543-143f01896dc9 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1241 microversion: 2.1 time: 0.075138 Sep 22 15:02:10.695627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 293/603] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:10 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:10.695884 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:10.825139 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:10.833579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-73a5a223-2621-4117-b639-6f57bc882242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.169322 Sep 22 15:02:10.834153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 311/604] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:10 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:11.029350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:11.029977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:11.036368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:11.036869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:11.037300 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:11.038010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:11.038503 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:11.038962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:11.179194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:11.188196 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f08881e2-f982-43ce-ab85-526e523bb688 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.162704 Sep 22 15:02:11.188787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 294/605] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:11 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:11.709508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:11.710048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:11.717310 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:11.717796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:11.718233 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:11.718960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:11.719415 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:11.719842 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:11.788383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:11.796292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1672818d-aa26-4435-a5d4-ed0e02b09c60 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1293 microversion: 2.1 time: 0.090729 Sep 22 15:02:11.796872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 312/606] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:11 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:11.860370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:11.861354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:11.868468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:11.869216 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:11.869659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:11.870370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:11.870861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:11.871638 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:12.021493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:12.030456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e71dc4c3-7a91-48ae-9bcf-5b904a0f1836 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.174114 Sep 22 15:02:12.031072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 295/607] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:11 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:12.211902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:12.213382 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:12.219450 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:12.219877 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:12.220317 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:12.221016 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:12.221468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:12.222025 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:12.356896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:12.365082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7a12d065-8700-46c0-bb5a-3c37938eeaa7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.157052 Sep 22 15:02:12.365653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 313/608] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:12 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:12.820072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:12.820782 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:12.828095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:12.828800 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:12.829198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:12.829961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:12.830413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:12.831002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:12.960381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:12.968430 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-68b74aaf-b9f5-4768-b530-1da6223f0fdc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.152522 Sep 22 15:02:12.968994 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 296/609] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:12 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:13.053910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:13.054533 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:13.062542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:13.063144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:13.063614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:13.064367 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:13.064828 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:13.065258 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:13.203727 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:13.213268 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2590797d-19fa-4da4-b8fe-7327f7612d9a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.163136 Sep 22 15:02:13.215090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 314/610] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:13 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:13.300000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-e661bb52-9f09-407e-ac08-4ccd57649132 req-4e48ee0a-d68a-4267-8fed-03e9ca681998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4ac3fbb-deaf-4c39-9620-7db9ced29124", "tag": "46a5eff0-933d-41e2-9be3-6fbcac079d57"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:13.310669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e661bb52-9f09-407e-ac08-4ccd57649132 req-4e48ee0a-d68a-4267-8fed-03e9ca681998 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:13.311187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e661bb52-9f09-407e-ac08-4ccd57649132 req-4e48ee0a-d68a-4267-8fed-03e9ca681998 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:13.311616 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e661bb52-9f09-407e-ac08-4ccd57649132 req-4e48ee0a-d68a-4267-8fed-03e9ca681998 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:13.322653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-e661bb52-9f09-407e-ac08-4ccd57649132 req-4e48ee0a-d68a-4267-8fed-03e9ca681998 service nova] Creating event network-changed:46a5eff0-933d-41e2-9be3-6fbcac079d57 for instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 on hv-cinder-84456 Sep 22 15:02:13.327825 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-e661bb52-9f09-407e-ac08-4ccd57649132 req-4e48ee0a-d68a-4267-8fed-03e9ca681998 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031421 Sep 22 15:02:13.328597 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 297/611] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:13.389081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:13.389693 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:13.395835 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:13.396305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:13.396732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:13.397420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:13.397865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:13.398284 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:13.539430 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:13.549351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cb455e9e-2d80-478d-b4d1-f0634b8b843e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.163979 Sep 22 15:02:13.550029 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 315/612] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:13 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:13.991200 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:13.992679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:14.000188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:14.001213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:14.001675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:14.002394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:14.002893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:14.003356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:14.148135 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:14.157462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a37e5f43-f831-4aaf-9dfa-57176d657a19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.170940 Sep 22 15:02:14.158026 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 298/613] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:13 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:14.237298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:14.237912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:14.244299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:14.244785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:14.245224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:14.245924 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:14.246383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:14.246833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:14.380712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:14.389753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3bc06e17-8659-4dc6-b1ce-2c024d0504d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.156329 Sep 22 15:02:14.390322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 316/614] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:14 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:14.573996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:14.574705 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:14.580868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:14.581358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:14.581794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:14.582490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:14.583006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:14.583460 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:14.729530 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:14.740199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79e454f2-076f-487c-8c39-9295a1031106 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.170582 Sep 22 15:02:14.749932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 299/615] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:14 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:15.180339 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:15.180947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:15.186928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:15.187424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:15.187846 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:15.188525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:15.188973 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:15.189387 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:15.318408 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:15.326203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b1800fd0-ceed-43bc-a27a-c415df5159e4 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.149724 Sep 22 15:02:15.326786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 317/616] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:15 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:15.412824 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:15.413364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:15.420576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:15.421058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:15.421492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:15.422189 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:15.422644 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:15.423093 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:15.550645 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:15.558933 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a25fe08c-eddf-450c-865f-8426fe7fd465 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.149986 Sep 22 15:02:15.559501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 300/617] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:15 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:15.765360 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:15.765971 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:15.772083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:15.772566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:15.772994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:15.773686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:15.774132 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:15.774551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:15.906805 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:15.914999 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3ca28ff1-7330-4479-8408-fe90a7561cac tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.153454 Sep 22 15:02:15.915588 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 318/618] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:15 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:16.349598 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:16.350259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:16.356760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:16.357233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:16.357659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:16.358334 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:16.358810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:16.359224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:16.483680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:16.491373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-aea043e2-b726-46d0-a381-06b346cb2cc2 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.145628 Sep 22 15:02:16.492671 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 301/619] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:16 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:16.583253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:16.583815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:16.590859 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:16.591378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:16.591822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:16.592546 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:16.593004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:16.593461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:16.724785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:16.733781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5b25e566-7226-4497-a442-1ed8818a96fb tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.154609 Sep 22 15:02:16.734351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 319/620] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:16 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:16.938514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:16.939079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:16.945038 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:16.945508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:16.945936 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:16.946607 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:16.947085 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:16.947497 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:17.075206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:17.083364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f3a829c7-6f0c-4ac4-af4a-62c3b2314ea7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.148768 Sep 22 15:02:17.083925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 302/621] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:16 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:17.519644 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:17.520190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:17.526522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:17.527127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:17.527909 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:17.528629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:17.529077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:17.529503 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:17.655174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:17.662790 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f5d9e7dc-03c2-41b6-8e54-c03edbea3385 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.147249 Sep 22 15:02:17.663356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 320/622] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:17 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:17.757941 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:17.758581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:17.765642 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:17.766110 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:17.766531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:17.767241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:17.767689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:17.768111 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:17.902279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:17.910827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-945a8001-56a1-4cc6-90c7-9573605af8ca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1725 microversion: 2.1 time: 0.156918 Sep 22 15:02:17.911493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 303/623] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:17 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:18.108266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:18.108881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:18.114814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:18.115387 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:18.115844 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:18.116526 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:18.116979 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:18.117523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:18.261570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:18.271596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a788a8f3-4c26-4ca8-8f0e-b66d399d0e13 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.167071 Sep 22 15:02:18.272464 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 321/624] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:18 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:18.686085 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:18.686609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:18.692590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:18.693062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:18.693486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:18.694169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:18.694613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:18.695060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:18.826668 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:18.834787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-425f398a-f726-4f35-81a1-d654099db49f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.153204 Sep 22 15:02:18.835587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 304/625] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:18 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:18.935314 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:18.935928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:18.942552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:18.943050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:18.943576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:18.944177 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:18.944631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:18.945085 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.087937 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:19.101566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c8d90c6e-b1f3-4200-bfda-467e1135f1b9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1702 microversion: 2.1 time: 0.170553 Sep 22 15:02:19.102158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 322/626] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:18 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1702 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:19.125464 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3c23fd0c-67f9-43fd-81a1-5891b5745e66 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:19.131789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c23fd0c-67f9-43fd-81a1-5891b5745e66 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:19.132279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c23fd0c-67f9-43fd-81a1-5891b5745e66 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:19.132708 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3c23fd0c-67f9-43fd-81a1-5891b5745e66 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.159013 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3c23fd0c-67f9-43fd-81a1-5891b5745e66 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Going to try to start instance {{(pid=120695) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 15:02:19.204199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3c23fd0c-67f9-43fd-81a1-5891b5745e66 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action" status: 202 len: 0 microversion: 2.1 time: 0.082500 Sep 22 15:02:19.204943 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 305/627] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:02:19 2022] POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 15:02:19.214635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:19.215459 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:19.222158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:19.222631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:19.223201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.223903 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:19.224363 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:19.224796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.296774 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:19.297469 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:19.303535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:19.304004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:19.304426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.305121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:19.305571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:19.305992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.390513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:19.399012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-293433e3-cfbd-4278-a927-6e6766994894 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1711 microversion: 2.1 time: 0.189177 Sep 22 15:02:19.399595 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 323/628] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:19 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1711 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:19.459020 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:19.467442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c96ea90b-3be9-4736-8c1b-bfb409c01f74 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.175493 Sep 22 15:02:19.468005 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 306/629] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:19 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:19.859947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:19.860558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:19.866626 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:19.867136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:19.867596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.868288 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:19.868736 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:19.869156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:19.996083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:20.003732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-46a471cb-2c04-4f26-ad41-13740483a6e3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.147664 Sep 22 15:02:20.004292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 324/630] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:19 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:20.422604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:20.423268 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:20.429664 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:20.430150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:20.430590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:20.431312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:20.431766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:20.432193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:20.491754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:20.492375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:20.498433 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:20.499175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:20.499463 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:20.500181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:20.500638 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:20.501098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:20.531207 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:20.547994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=10 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:20.602043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:20.611177 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4fd50ae2-9c14-4a37-81d7-37fa58f35aa9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1711 microversion: 2.1 time: 0.192388 Sep 22 15:02:20.611851 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 307/631] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:20 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1711 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:20.645909 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:20.655126 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-56effbe7-cecb-43f1-9ef2-4cf839045543 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.167186 Sep 22 15:02:20.655736 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 325/632] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:20 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:21.026571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:21.027200 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:21.029194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:21.034569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:21.035083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:21.035513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:21.036202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:21.036650 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:21.037066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:21.057910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:21.080941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-cbd5bc5a-f477-442d-ac33-843c11471613 req-bd735bf0-1802-429f-8808-e201dca3c979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ac3fbb-deaf-4c39-9620-7db9ced29124", "name": "network-vif-plugged", "status": "completed", "tag": "46a5eff0-933d-41e2-9be3-6fbcac079d57"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:21.094825 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-cbd5bc5a-f477-442d-ac33-843c11471613 req-bd735bf0-1802-429f-8808-e201dca3c979 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:21.095570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-cbd5bc5a-f477-442d-ac33-843c11471613 req-bd735bf0-1802-429f-8808-e201dca3c979 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:21.096324 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-cbd5bc5a-f477-442d-ac33-843c11471613 req-bd735bf0-1802-429f-8808-e201dca3c979 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:21.116709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-cbd5bc5a-f477-442d-ac33-843c11471613 req-bd735bf0-1802-429f-8808-e201dca3c979 service nova] Creating event network-vif-plugged:46a5eff0-933d-41e2-9be3-6fbcac079d57 for instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 on hv-cinder-84456 Sep 22 15:02:21.121670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-cbd5bc5a-f477-442d-ac33-843c11471613 req-bd735bf0-1802-429f-8808-e201dca3c979 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046399 Sep 22 15:02:21.122418 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 326/633] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:21.182258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:21.190449 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e635f596-0e1d-4822-833b-091aa394e006 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.167702 Sep 22 15:02:21.191089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 308/634] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:21 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:21.635792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:21.636506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:21.642637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:21.643163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:21.643602 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:21.644298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:21.644752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:21.645181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:21.679415 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:21.680127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:21.686608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:21.687145 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:21.687590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:21.688287 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:21.688742 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:21.689169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:21.830833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:21.839914 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-60b8cd1d-223a-4d65-8f4e-66b8a4b67404 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1711 microversion: 2.1 time: 0.208862 Sep 22 15:02:21.840491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 327/635] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:21 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1711 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:21.858979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:21.868989 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ad9db9c4-8de2-48aa-89d8-7feac10a96ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.193279 Sep 22 15:02:21.869649 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 309/636] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:21 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:22.213556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:22.214173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:22.220640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:22.221191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:22.221673 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:22.222378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:22.222857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:22.223289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:22.357184 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:22.359670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:22.367431 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ec593ff5-edb2-43b3-b785-950bdfc2accf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.157954 Sep 22 15:02:22.368109 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 328/637] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:22 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:22.863233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:22.863847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:22.870920 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:22.871406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:22.871843 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:22.872550 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:22.872996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:22.873422 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:22.895111 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:22.895849 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:22.901994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:22.902469 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:22.903007 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:22.903696 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:22.904140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:22.904558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:23.062491 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:23.070941 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2b01a482-069d-4bc9-a438-9a053fe8dc95 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1711 microversion: 2.1 time: 0.211545 Sep 22 15:02:23.071724 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 310/638] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:22 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1711 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:23.080132 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:23.088569 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9b16e432-9e5d-4e53-92f9-67a7c4877cf3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.197679 Sep 22 15:02:23.089129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 329/639] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:22 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:23.391805 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:23.392539 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:23.398768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:23.399251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:23.399745 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:23.400439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:23.401427 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:23.401855 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:23.533851 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:23.542203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e8cec5ff-a46d-4739-b534-392afb79d479 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.153748 Sep 22 15:02:23.542784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 311/640] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:23 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:24.094908 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:24.095522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:24.101947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:24.102429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:24.102899 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:24.103591 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:24.104068 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:24.104500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:24.112754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:24.113373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:24.120509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:24.120988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:24.121906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:24.122100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:24.122544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:24.122996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:24.300160 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:24.306915 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:24.309041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-473e7000-a87d-4974-bc2e-9e229754831a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1711 microversion: 2.1 time: 0.218032 Sep 22 15:02:24.309946 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 330/641] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:24 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1711 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:24.315935 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a9efe802-2ee2-4786-b2da-05e5f4560987 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.206963 Sep 22 15:02:24.316489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 312/642] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:24 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:24.564944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:24.565556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:24.567502 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:24.572821 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:24.573303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:24.573748 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:24.574432 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:24.574912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:24.575334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:24.706006 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:24.713834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-061d47f4-8eab-4444-8aa0-95525c796f28 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1366 microversion: 2.1 time: 0.152830 Sep 22 15:02:24.714400 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 331/643] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:24 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:25.332950 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:25.333555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:25.339912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:25.340530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:25.340655 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.341021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.342132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.342865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.343324 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.343753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.347578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.348057 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.348485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.349179 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.349622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.350037 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.546348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:25.549154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:25.554686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8f32f320-19e9-401a-a96f-745ce181df26 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1711 microversion: 2.1 time: 0.225561 Sep 22 15:02:25.555285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 313/644] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:25 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1711 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:25.557364 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9d3dfea7-5155-450c-a3a2-933b4bd4f425 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1734 microversion: 2.1 time: 0.221504 Sep 22 15:02:25.558122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 332/645] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:25 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:25.560856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:25.561346 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:25.567165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.567642 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.568068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.568756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.569199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.569614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.661186 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lazy-loading 'services' on Instance uuid 330710ad-243c-419d-ab05-f4a5321236a4 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:25.737232 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:25.738120 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:25.742653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-57d4ef28-0627-43fc-bb90-47853107790c tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "DELETE /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4/os-volume_attachments/d9b0d290-ae5c-4dd6-9645-b50ef0019189" status: 202 len: 0 microversion: 2.1 time: 0.186134 Sep 22 15:02:25.743489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 314/646] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:02:25 2022] DELETE /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4/os-volume_attachments/d9b0d290-ae5c-4dd6-9645-b50ef0019189 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:02:25.744443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.745325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.745765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.746534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.747080 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.750105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.891240 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:25.898798 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-934fd42f-d829-4052-9fcc-a510f78b0376 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1557 microversion: 2.1 time: 0.166131 Sep 22 15:02:25.899367 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 333/647] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:25 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:25.926386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:25.927010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:25.933585 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.934065 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.934500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:25.935232 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:25.935682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:25.936107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:26.012977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f07fc15d-8502-4194-ba87-11e9f50e43e8 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090967 Sep 22 15:02:26.013616 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 315/648] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 15:02:25 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:26.580343 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:26.581180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:26.581698 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:26.582312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:26.589171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:26.589382 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:26.589606 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:26.590034 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:26.590150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:26.590644 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:26.590832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:26.591227 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:26.591658 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:26.592128 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:26.592658 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:26.593506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.079563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:27.088851 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bcf8c488-51e2-46ae-879d-fec5a5d03546 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1711 microversion: 2.1 time: 0.512307 Sep 22 15:02:27.089336 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 334/649] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:26 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1711 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:27.095070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:27.103887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-72e74552-310f-41e0-ad6c-de8506e5aac8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1714 microversion: 2.1 time: 0.526418 Sep 22 15:02:27.104949 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 316/650] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:26 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1714 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:27.220706 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:27.221253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:27.228161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.228647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.229612 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.230328 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.230797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.231216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.354871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-422fde69-36e4-43b1-882f-7c96dd7ff29c req-b81713f8-7a46-4f57-ab1a-a01a1964ebdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4ac3fbb-deaf-4c39-9620-7db9ced29124", "tag": "46a5eff0-933d-41e2-9be3-6fbcac079d57"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:27.366927 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:27.371083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] HTTP exception thrown: Cannot 'detach_volume' instance 0cd72afb-0e38-47ae-a54e-2667b786a75b while it is in vm_state rescued Sep 22 15:02:27.371267 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-422fde69-36e4-43b1-882f-7c96dd7ff29c req-b81713f8-7a46-4f57-ab1a-a01a1964ebdc service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.371982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-422fde69-36e4-43b1-882f-7c96dd7ff29c req-b81713f8-7a46-4f57-ab1a-a01a1964ebdc service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.372656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-422fde69-36e4-43b1-882f-7c96dd7ff29c req-b81713f8-7a46-4f57-ab1a-a01a1964ebdc service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Request method failure captured: Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments/faf8502c-c0e8-4330-a969-1ecb5845c941 HTTP/1.1 Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgIMz35eZr-TOgMxIor3-RJ8UB8GkoNCikvHlilSlMfG3f6kIoqDS7rJu8k1SCoFhaU2Z5UUxc8E7pBOqBA8xmEsBh1JbrbP_k6qe6D8aiGRIwVEJsvd44JjqAqER7hoFNvQMs6kahtDcRFKgXq2Dx6AdJ4k9iRk-nXcA-qn1K-cps Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:02:27.372786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 038365d6ba7041f4af386767d98ed709 Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:02:27.374058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Cannot 'detach_volume' instance 0cd72afb-0e38-47ae-a54e-2667b786a75b while it is in vm_state rescued Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'server_id': '0cd72afb-0e38-47ae-a54e-2667b786a75b', 'id': 'faf8502c-c0e8-4330-a969-1ecb5845c941'} Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0cd72afb-0e38-47ae-a54e-2667b786a75b in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:02:27.374721 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0cd72afb-0e38-47ae-a54e-2667b786a75b while it is in vm_state rescued Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0cd72afb-0e38-47ae-a54e-2667b786a75b while it is in vm_state rescued Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:27.375982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Returning 409 to user: Cannot 'detach_volume' instance 0cd72afb-0e38-47ae-a54e-2667b786a75b while it is in vm_state rescued {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:02:27.378216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c1a31394-870f-4816-9009-8a4b10eb9da9 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments/faf8502c-c0e8-4330-a969-1ecb5845c941" status: 409 len: 152 microversion: 2.1 time: 0.157684 Sep 22 15:02:27.378216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 335/651] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:02:27 2022] DELETE /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments/faf8502c-c0e8-4330-a969-1ecb5845c941 => generated 152 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 22 15:02:27.383796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:27.384473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:27.389795 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-422fde69-36e4-43b1-882f-7c96dd7ff29c req-b81713f8-7a46-4f57-ab1a-a01a1964ebdc service nova] Creating event network-changed:46a5eff0-933d-41e2-9be3-6fbcac079d57 for instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 on hv-cinder-84456 Sep 22 15:02:27.391018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.391586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.392088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.393535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.394109 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.394429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-422fde69-36e4-43b1-882f-7c96dd7ff29c req-b81713f8-7a46-4f57-ab1a-a01a1964ebdc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043738 Sep 22 15:02:27.394607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.395066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 317/652] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:27.464670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1e836855-e073-43fb-a0e6-fea60742e612 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "POST /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/action" status: 202 len: 0 microversion: 2.1 time: 0.085192 Sep 22 15:02:27.468308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 336/653] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:02:27 2022] POST /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:02:27.473880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:27.474579 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:27.481259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.481742 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.482175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.482901 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.483350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.483775 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.665106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:27.676780 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7c4e41c9-2835-4c74-9206-7a2861a4bd22 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1722 microversion: 2.1 time: 0.206972 Sep 22 15:02:27.677604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 318/654] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:27 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:27.946574 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:27.947345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:27.959501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.960040 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.960484 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.961223 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:27.961683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:27.962358 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:27.999804 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Going to try to terminate instance {{(pid=120694) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:02:28.096292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d506a32c-27fa-4ac1-ab21-096e8fde3236 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "DELETE /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 204 len: 0 microversion: 2.1 time: 0.154921 Sep 22 15:02:28.098076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 337/655] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:02:27 2022] DELETE /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:02:28.109438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:28.110847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:28.114651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:28.115217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:28.118713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:28.119225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:28.120190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:28.121222 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:28.121780 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:28.122500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:28.128153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:28.128558 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:28.129043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:28.129719 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:28.130185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:28.130608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:28.345309 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:28.353680 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:28.355126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0817f152-3fc0-4270-ac47-df5b1259b970 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1513 microversion: 2.1 time: 0.251246 Sep 22 15:02:28.357709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 319/656] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:28 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:28.364149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4fbe0932-a567-4940-9226-1933aa853f4f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1715 microversion: 2.1 time: 0.254004 Sep 22 15:02:28.364895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 338/657] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:28 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1715 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:28.700396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:28.701010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:28.707431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:28.707915 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:28.708351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:28.709042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:28.709500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:28.709932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:28.838896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:28.847074 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-53a31a66-0d47-485f-aba6-cf5a51cdded1 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1722 microversion: 2.1 time: 0.150513 Sep 22 15:02:28.847635 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 320/658] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:28 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:29.379286 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:29.380013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:29.387093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:29.387570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:29.388003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:29.388706 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:29.389153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:29.389585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:29.520565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:29.528776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-60109004-1361-4b85-888c-e1b7af4e3fee tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1513 microversion: 2.1 time: 0.153286 Sep 22 15:02:29.529349 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 339/659] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:29 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:29.870664 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:29.871315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:29.877989 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:29.878471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:29.879013 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:29.879712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:29.880164 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:29.880589 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:30.009321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:30.018191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8befe6c4-66d9-48bb-8c73-f08aef6c6bec tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1722 microversion: 2.1 time: 0.151479 Sep 22 15:02:30.018786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 321/660] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:29 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:30.552995 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:30.553610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:30.561163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:30.561672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:30.562156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:30.563056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:30.563660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:30.564241 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:30.637016 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:30.644525 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-57b3f2bc-bb6b-412c-8f3e-783deb5095be req-c95809c0-6ab5-4f00-9f56-d83b6f39ec4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330710ad-243c-419d-ab05-f4a5321236a4", "name": "network-vif-deleted", "tag": "76b7e785-cd68-4fa5-bc5f-520d82726178"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:30.649515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c54f58c8-6e26-438a-9ace-c6329ac4557a tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1471 microversion: 2.1 time: 0.100006 Sep 22 15:02:30.650639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 340/661] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:30 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1471 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:30.654854 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-57b3f2bc-bb6b-412c-8f3e-783deb5095be req-c95809c0-6ab5-4f00-9f56-d83b6f39ec4e service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:30.655576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-57b3f2bc-bb6b-412c-8f3e-783deb5095be req-c95809c0-6ab5-4f00-9f56-d83b6f39ec4e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:30.656056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-57b3f2bc-bb6b-412c-8f3e-783deb5095be req-c95809c0-6ab5-4f00-9f56-d83b6f39ec4e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:30.670766 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-57b3f2bc-bb6b-412c-8f3e-783deb5095be req-c95809c0-6ab5-4f00-9f56-d83b6f39ec4e service nova] Creating event network-vif-deleted:76b7e785-cd68-4fa5-bc5f-520d82726178 for instance 330710ad-243c-419d-ab05-f4a5321236a4 on hv-cinder-84456 Sep 22 15:02:30.675764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-57b3f2bc-bb6b-412c-8f3e-783deb5095be req-c95809c0-6ab5-4f00-9f56-d83b6f39ec4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034853 Sep 22 15:02:30.676354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 322/662] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:02:31.042874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:31.043485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:31.049515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:31.050003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:31.050436 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:31.051171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:31.051625 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:31.052057 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:31.181516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:31.189712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3511396e-3ce0-43be-86ba-a7b60e2a9fe8 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1722 microversion: 2.1 time: 0.151379 Sep 22 15:02:31.190272 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 341/663] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:31 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:31.676643 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:31.677242 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:31.683856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:31.684331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:31.684760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:31.685442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:31.685894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:31.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:31.749429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:31.757215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c53608c5-978c-4955-a088-8ade89671b56 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1471 microversion: 2.1 time: 0.085320 Sep 22 15:02:31.757785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 323/664] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:31 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1471 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:32.213373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:32.213987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:32.220616 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:32.221305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:32.221683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:32.222370 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:32.222858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:32.223287 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:32.353040 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:32.355953 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:32.363222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-76f1092b-096c-40ce-8d5c-ab0137803973 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1722 microversion: 2.1 time: 0.153898 Sep 22 15:02:32.363782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 342/665] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:32 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:32.781699 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:32.782333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:32.788746 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:32.789230 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:32.789662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:32.790352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:32.790841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:32.791265 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:32.820768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:32.821554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:32.822000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:32.823051 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lazy-loading 'fault' on Instance uuid 330710ad-243c-419d-ab05-f4a5321236a4 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:32.863207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463811a630e4b90b1cd96e4dec020a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26875c24ce944501a6b23188c784d9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:32.870996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a1641e54-54c3-4a10-837d-460309e68191 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 200 len: 1308 microversion: 2.1 time: 0.093161 Sep 22 15:02:32.871565 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 324/666] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:32 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:33.387054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:33.387673 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:33.395308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:33.395794 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:33.396226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:33.396915 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:33.397368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:33.397937 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:33.527298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:33.535489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ac3be71d-2016-430f-bede-2a2f5030c2d6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1728 microversion: 2.1 time: 0.152924 Sep 22 15:02:33.536055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 343/667] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:33 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:02:33.559425 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:33.559946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:33.566010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:33.566488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:33.566970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:33.567659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:33.568110 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:33.568529 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:33.647051 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8b2e70fd-f912-44e3-99a5-03d8fa95b86f tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091998 Sep 22 15:02:33.647669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 325/668] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 15:02:33 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:33.894581 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:33.895161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] [instance: 330710ad-243c-419d-ab05-f4a5321236a4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:33.901047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:33.901525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:33.901960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:33.902656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:33.903132 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:33.903554 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:33.917596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] HTTP exception thrown: Instance 330710ad-243c-419d-ab05-f4a5321236a4 could not be found. Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Request method failure captured: Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 HTTP/1.1 Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHh6mAmWaDma-TZxvI8zwFANe0IlJ1gQVRUjFstZtOlGaxffpWvNYrAmaR5V9-nJkVU6duYOWUbTxUtEbMzfKr-JWgSipqK4UicgnY6DYo7i7WGON4IQhuA2MIJZaAIWCCThxhF1iDZYISdP1efwp5cM7a0f2WSNHZXaE6TiG6Z09VI Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 26875c24ce944501a6b23188c784d9f5 Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-VolumesSnapshotTestJSON-436352613 Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:02:33.919253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26875c24ce944501a6b23188c784d9f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_26875c24ce944501a6b23188c784d9f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26875c24ce944501a6b23188c784d9f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/26875c24ce944501a6b23188c784d9f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-VolumesSnapshotTestJSON-436352613 Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 26875c24ce944501a6b23188c784d9f5 Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-436352613 Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-VolumesSnapshotTestJSON-436352613-project Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 8463811a630e4b90b1cd96e4dec020a2 Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-VolumesSnapshotTestJSON-436352613-project Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 330710ad-243c-419d-ab05-f4a5321236a4 could not be found. Sep 22 15:02:33.920740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '330710ad-243c-419d-ab05-f4a5321236a4'} Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330710ad-243c-419d-ab05-f4a5321236a4 could not be found. Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:02:33.921548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330710ad-243c-419d-ab05-f4a5321236a4 could not be found. Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330710ad-243c-419d-ab05-f4a5321236a4 could not be found. Sep 22 15:02:33.922720 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:02:33.923892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] Returning 404 to user: Instance 330710ad-243c-419d-ab05-f4a5321236a4 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:02:33.923892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0caf89a2-9912-45f2-b6db-339a52852ae5 tempest-VolumesSnapshotTestJSON-436352613 tempest-VolumesSnapshotTestJSON-436352613-project] 10.222.0.26 "GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4" status: 404 len: 111 microversion: 2.1 time: 0.030013 Sep 22 15:02:33.923892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 344/669] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:02:33 2022] GET /compute/v2.1/servers/330710ad-243c-419d-ab05-f4a5321236a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:02:34.576486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-36cd2048-284e-4dfe-bb81-882c4445b502 req-45f5a294-3132-4aa7-9d88-669156d58286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd72afb-0e38-47ae-a54e-2667b786a75b", "tag": "643356c5-34f7-492b-a963-cdc7638a5c5a"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:34.587761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-36cd2048-284e-4dfe-bb81-882c4445b502 req-45f5a294-3132-4aa7-9d88-669156d58286 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:34.589018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-36cd2048-284e-4dfe-bb81-882c4445b502 req-45f5a294-3132-4aa7-9d88-669156d58286 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:34.589511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-36cd2048-284e-4dfe-bb81-882c4445b502 req-45f5a294-3132-4aa7-9d88-669156d58286 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:34.593906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:34.602458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-36cd2048-284e-4dfe-bb81-882c4445b502 req-45f5a294-3132-4aa7-9d88-669156d58286 service nova] Creating event network-changed:643356c5-34f7-492b-a963-cdc7638a5c5a for instance 0cd72afb-0e38-47ae-a54e-2667b786a75b on hv-cinder-84456 Sep 22 15:02:34.607786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-36cd2048-284e-4dfe-bb81-882c4445b502 req-45f5a294-3132-4aa7-9d88-669156d58286 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036164 Sep 22 15:02:34.608385 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 326/670] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:02:36.622916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-81e78464-3038-41ed-9cce-7a695c15e03d req-cfdea97a-82af-4feb-9759-22e4b577b9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd72afb-0e38-47ae-a54e-2667b786a75b", "tag": "643356c5-34f7-492b-a963-cdc7638a5c5a"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:36.632762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-81e78464-3038-41ed-9cce-7a695c15e03d req-cfdea97a-82af-4feb-9759-22e4b577b9d0 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:36.633296 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-81e78464-3038-41ed-9cce-7a695c15e03d req-cfdea97a-82af-4feb-9759-22e4b577b9d0 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:36.633733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-81e78464-3038-41ed-9cce-7a695c15e03d req-cfdea97a-82af-4feb-9759-22e4b577b9d0 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:36.645548 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-81e78464-3038-41ed-9cce-7a695c15e03d req-cfdea97a-82af-4feb-9759-22e4b577b9d0 service nova] Creating event network-changed:643356c5-34f7-492b-a963-cdc7638a5c5a for instance 0cd72afb-0e38-47ae-a54e-2667b786a75b on hv-cinder-84456 Sep 22 15:02:36.651292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-81e78464-3038-41ed-9cce-7a695c15e03d req-cfdea97a-82af-4feb-9759-22e4b577b9d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031643 Sep 22 15:02:36.651878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 345/671] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:38.432725 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:38.433481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:38.439708 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:38.440206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:38.440633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:38.441317 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:38.441761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:38.442179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:38.473370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-30b6962d-b5ab-468e-9a70-22f4d9d118ab tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments/52ac1495-c87c-44ae-8e5e-223b9a216c74" status: 200 len: 194 microversion: 2.20 time: 0.046182 Sep 22 15:02:38.474145 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 327/672] 10.222.0.26 () {60 vars in 1454 bytes} [Thu Sep 22 15:02:38 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments/52ac1495-c87c-44ae-8e5e-223b9a216c74 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 15:02:38.554449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:38.555066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:38.562515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:38.563231 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:38.563849 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:38.564890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:38.565342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:38.565921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:38.666469 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lazy-loading 'services' on Instance uuid c45e6623-9952-42a0-b01e-85001ae14fd2 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:38.789787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-910231d7-e89a-4775-818c-ac1a00f9451d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments/52ac1495-c87c-44ae-8e5e-223b9a216c74" status: 202 len: 0 microversion: 2.20 time: 0.240589 Sep 22 15:02:38.791173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 346/673] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Sep 22 15:02:38 2022] DELETE /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments/52ac1495-c87c-44ae-8e5e-223b9a216c74 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:02:38.800111 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:38.802945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:38.810461 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:38.811034 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:38.811633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:38.812658 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:38.813262 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:38.813961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:38.849815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0949010d-ced3-4e04-953b-d2a3f73dda4a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053964 Sep 22 15:02:38.850977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 328/674] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 22 15:02:38 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 15:02:39.864803 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:39.867050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:39.873290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:39.873769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:39.874204 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:39.874926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:39.875380 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:39.875806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:39.910057 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f50cd41b-8e5c-49d4-8857-4e09cf1a0969 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050199 Sep 22 15:02:39.910618 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 347/675] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 22 15:02:39 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:02:39.974655 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:39.975177 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:39.981528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:39.982006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:39.982441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:39.983157 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:39.983607 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:39.984022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:40.016723 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:02:40.115154 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-97d9cb01-d502-4b3f-8438-be9eda57d943 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 204 len: 0 microversion: 2.20 time: 0.144673 Sep 22 15:02:40.115665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 329/676] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 22 15:02:39 2022] DELETE /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 15:02:40.123913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:40.124583 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:40.130864 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:40.131351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:40.131785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:40.132485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:40.132935 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:40.133354 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:40.266790 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:40.275877 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:40.277407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:40.278616 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0e422761-639d-4ead-ae4c-b32caa92aef2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.158657 Sep 22 15:02:40.279507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 348/677] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:40 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:41.306406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:41.307856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:41.314497 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:41.315009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:41.315437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:41.316126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:41.316567 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:41.317022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:41.466441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:41.474941 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:41.476405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:41.477576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a00e3171-a430-4885-8e41-291da8b9e00a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.175403 Sep 22 15:02:41.478139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 330/678] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:41 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:42.504770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:42.505408 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:42.512220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:42.512728 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:42.513156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:42.513865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:42.514329 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:42.514770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:42.652982 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:42.672493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:42.674473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:42.676082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-19b829a4-2b4e-46d3-8b19-42929169d850 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1724 microversion: 2.20 time: 0.175383 Sep 22 15:02:42.677225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 349/679] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:42 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:42.941298 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-9ffb16bf-61de-42dc-9d9e-0170fe054952 req-5be08719-7ed7-4b2e-ab86-ee15879f616e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45e6623-9952-42a0-b01e-85001ae14fd2", "name": "network-vif-deleted", "tag": "ecbef20d-ee6a-4cae-8583-7ab49d776a37"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:42.952474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-9ffb16bf-61de-42dc-9d9e-0170fe054952 req-5be08719-7ed7-4b2e-ab86-ee15879f616e service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:42.952969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-9ffb16bf-61de-42dc-9d9e-0170fe054952 req-5be08719-7ed7-4b2e-ab86-ee15879f616e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:42.953402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-9ffb16bf-61de-42dc-9d9e-0170fe054952 req-5be08719-7ed7-4b2e-ab86-ee15879f616e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:42.965758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-9ffb16bf-61de-42dc-9d9e-0170fe054952 req-5be08719-7ed7-4b2e-ab86-ee15879f616e service nova] Creating event network-vif-deleted:ecbef20d-ee6a-4cae-8583-7ab49d776a37 for instance c45e6623-9952-42a0-b01e-85001ae14fd2 on hv-cinder-84456 Sep 22 15:02:42.971032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-9ffb16bf-61de-42dc-9d9e-0170fe054952 req-5be08719-7ed7-4b2e-ab86-ee15879f616e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Sep 22 15:02:42.971776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 331/680] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:43.701893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:43.702505 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:43.709139 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:43.709620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:43.710057 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:43.710792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:43.711259 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:43.711941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:43.745673 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:43.746189 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:43.746623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:43.747103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lazy-loading 'fault' on Instance uuid c45e6623-9952-42a0-b01e-85001ae14fd2 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:43.790873 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:43.799784 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:43.801236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:43.802386 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-72c6235d-51f8-455a-b5af-fd94a34811f4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1372 microversion: 2.20 time: 0.104439 Sep 22 15:02:43.803004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 350/681] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:43 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:44.828819 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:44.829511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:44.835820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:44.836301 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:44.836987 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:44.837666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:44.838118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:44.839222 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:44.869956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:44.870431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:44.870899 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:44.871344 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lazy-loading 'fault' on Instance uuid c45e6623-9952-42a0-b01e-85001ae14fd2 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:44.912465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:44.920576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:44.922006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:44.923177 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-52a3e544-2097-469c-abca-bfde55a7c373 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1372 microversion: 2.20 time: 0.099045 Sep 22 15:02:44.923727 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 332/682] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:44 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:45.947639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:45.948248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:45.954498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:45.955010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:45.955440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:45.956125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:45.956596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:45.957056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:45.990589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:45.991112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:45.991552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:45.992099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lazy-loading 'fault' on Instance uuid c45e6623-9952-42a0-b01e-85001ae14fd2 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:02:46.037902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:46.046834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:46.048278 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:46.049654 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-352e4bea-3e0c-44ee-921d-8d0945e6913e tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 200 len: 1372 microversion: 2.20 time: 0.105678 Sep 22 15:02:46.050615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 351/683] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:45 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:47.076475 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:47.077115 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:47.084113 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:47.084652 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:47.085095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:47.086022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:47.086785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:47.087245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:47.101614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] HTTP exception thrown: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Request method failure captured: Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 HTTP/1.1 Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgMP8XPQv6owQvaZdj05Sofe_IjaSuYoI5ZV9EjSjIKXPiQPDFkqxsoK9alhn_kg8wReB7qczvch4JAee56qPi0pzSR_VDBOu4CZNkmI7ntTkE_SP4KrWHAotdxmSjUj_LIqeEydKPQXmBGeysDisuLqHoL0OgEfNPiR3-vqGnA5Go Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:02:47.103379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 23d683cdc90041b5b29767fa2e2107e2 Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:02:47.105522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'c45e6623-9952-42a0-b01e-85001ae14fd2'} Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:02:47.106433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:02:47.108021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:02:47.109413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Returning 404 to user: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:02:47.109413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-adaacb83-8aa2-453d-a8db-f1382b45c7ee tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 404 len: 111 microversion: 2.20 time: 0.032767 Sep 22 15:02:47.109413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 333/684] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:47 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:02:47.114647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-df228366-a996-4458-bc39-df7d8381e9b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '.version_select at 0x7f77e62e2940>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:47.134593 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-df228366-a996-4458-bc39-df7d8381e9b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981115340" status: 204 len: 0 microversion: 2.20 time: 0.023725 Sep 22 15:02:47.138611 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 352/685] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 22 15:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981115340 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 15:02:47.801543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-260bd316-984b-486c-9584-1c23791c52e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'create', calling method: .version_select at 0x7f77e61b6a60>, body: {"keypair": {"name": "tempest-keypair-1372792787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcKgB/NIs6VIr/SMSZgyhqaAnY349JdPAN0y/r5WGNrK2MKX/E2r+HnkiGvLDqwRvFWstPRISfGQ+GE2OYF2rGTotM9xSZ8KQaJFNGwRb7ZP3fmlILBySUeS5t1KAg+JQ=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:47.817127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-260bd316-984b-486c-9584-1c23791c52e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for project aef8a9d089c9446697837d5ebe2154c8. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:02:47.821001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-260bd316-984b-486c-9584-1c23791c52e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for user 23d683cdc90041b5b29767fa2e2107e2 and project aef8a9d089c9446697837d5ebe2154c8. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:02:47.844856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-260bd316-984b-486c-9584-1c23791c52e2 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047282 Sep 22 15:02:47.845458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 334/686] 10.222.0.26 () {62 vars in 1200 bytes} [Thu Sep 22 15:02:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 22 15:02:49.418631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-58143421", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8742f16c-32ab-48fd-81ef-195b3c65c9b9"}], "security_groups": [{"name": "tempest-securitygroup--1669524716"}], "key_name": "tempest-keypair-1372792787", "user_data": "}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:49.532097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] validate_networks() for [('8742f16c-32ab-48fd-81ef-195b3c65c9b9', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:02:49.920227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:02:49.920674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:02:49.921208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:02:49.921618 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:02:49.922033 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:02:49.930810 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:49.931238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:49.931659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:49.932874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:49.933329 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:49.933754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:49.951363 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for project aef8a9d089c9446697837d5ebe2154c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:02:49.955353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Getting quotas for user 23d683cdc90041b5b29767fa2e2107e2 and project aef8a9d089c9446697837d5ebe2154c8. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:02:49.966561 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:02:49.968888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:02:50.017550 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-64d53616-dc18-4f23-9b84-9ec8db86a2fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.603834 Sep 22 15:02:50.018211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 353/687] 10.222.0.26 () {62 vars in 1188 bytes} [Thu Sep 22 15:02:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 22 15:02:50.030199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-39426ee8-97fa-4d69-8fad-1c0f1eb9d1f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:50.030862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-39426ee8-97fa-4d69-8fad-1c0f1eb9d1f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:50.095910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-39426ee8-97fa-4d69-8fad-1c0f1eb9d1f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:50.103481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-39426ee8-97fa-4d69-8fad-1c0f1eb9d1f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:50.105569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-39426ee8-97fa-4d69-8fad-1c0f1eb9d1f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:50.111279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-39426ee8-97fa-4d69-8fad-1c0f1eb9d1f7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1280 microversion: 2.20 time: 0.085606 Sep 22 15:02:50.111859 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 335/688] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:50 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:51.137938 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:51.138752 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:51.145530 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:51.146021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:51.146490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:51.147220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:51.147704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:51.148129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:51.218755 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:51.228748 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:51.230991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:51.232337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b41b69cd-fcdb-4a7d-86d8-be80db364644 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1332 microversion: 2.20 time: 0.098977 Sep 22 15:02:51.233092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 354/689] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:51 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:52.258442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:52.259318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:52.266188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:52.266979 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:52.267583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:52.268350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:52.269107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:52.269609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:52.401853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:52.410219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:52.411778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:52.412939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-444515d8-2235-4072-a644-dec9ba1908d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1406 microversion: 2.20 time: 0.158432 Sep 22 15:02:52.413498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 336/690] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:52 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:52.709501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-f0f5f4a7-e050-485c-9669-0a2e4786805a req-75b56c10-fe42-4e31-86ea-6c6834980d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eaa6dc-ecc8-44ac-a552-9753ed98baa4", "tag": "2a4fb816-a034-43e4-973a-90bfa5151681"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:52.724527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f0f5f4a7-e050-485c-9669-0a2e4786805a req-75b56c10-fe42-4e31-86ea-6c6834980d58 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:52.725166 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f0f5f4a7-e050-485c-9669-0a2e4786805a req-75b56c10-fe42-4e31-86ea-6c6834980d58 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:52.725592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f0f5f4a7-e050-485c-9669-0a2e4786805a req-75b56c10-fe42-4e31-86ea-6c6834980d58 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:52.739827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-f0f5f4a7-e050-485c-9669-0a2e4786805a req-75b56c10-fe42-4e31-86ea-6c6834980d58 service nova] Creating event network-changed:2a4fb816-a034-43e4-973a-90bfa5151681 for instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 on hv-cinder-84456 Sep 22 15:02:52.746060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-f0f5f4a7-e050-485c-9669-0a2e4786805a req-75b56c10-fe42-4e31-86ea-6c6834980d58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039369 Sep 22 15:02:52.746860 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 355/691] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:53.440547 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:53.441147 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:53.447569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:53.448043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:53.448472 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:53.449145 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:53.449591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:53.450009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:53.580768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:53.589580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:53.591057 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:53.592159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ed612dae-4633-46c1-991d-bf8bc93de56a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1406 microversion: 2.20 time: 0.155519 Sep 22 15:02:53.592719 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 337/692] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:53 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:54.618399 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:54.619212 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:54.621711 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:54.629384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:54.629384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:54.629384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:54.629384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:54.630090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:54.630090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:54.766898 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:54.774994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:54.776423 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:54.778011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-22a19fa3-004e-4246-9cd3-cb99f851adbf tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1406 microversion: 2.20 time: 0.163866 Sep 22 15:02:54.778565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 356/693] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:54 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:55.803489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:55.804119 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:55.810478 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:55.810992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:55.811426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:55.812104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:55.812552 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:55.812974 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:55.939868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:55.947954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:55.949907 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:55.951067 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1ef3af78-407f-4ec1-8ef5-055bb92a75cc tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1406 microversion: 2.20 time: 0.151452 Sep 22 15:02:55.951666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 338/694] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:55 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:56.313519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-9250ae91-9dc2-4874-bde4-076306f1fed1 req-36e8308f-064c-4d00-ac9b-4cf88c9c9dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eaa6dc-ecc8-44ac-a552-9753ed98baa4", "name": "network-vif-plugged", "status": "completed", "tag": "2a4fb816-a034-43e4-973a-90bfa5151681"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:02:56.325113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-9250ae91-9dc2-4874-bde4-076306f1fed1 req-36e8308f-064c-4d00-ac9b-4cf88c9c9dc8 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:56.325600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-9250ae91-9dc2-4874-bde4-076306f1fed1 req-36e8308f-064c-4d00-ac9b-4cf88c9c9dc8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:56.326032 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-9250ae91-9dc2-4874-bde4-076306f1fed1 req-36e8308f-064c-4d00-ac9b-4cf88c9c9dc8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:56.339244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-9250ae91-9dc2-4874-bde4-076306f1fed1 req-36e8308f-064c-4d00-ac9b-4cf88c9c9dc8 service nova] Creating event network-vif-plugged:2a4fb816-a034-43e4-973a-90bfa5151681 for instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 on hv-cinder-84456 Sep 22 15:02:56.344321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-9250ae91-9dc2-4874-bde4-076306f1fed1 req-36e8308f-064c-4d00-ac9b-4cf88c9c9dc8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034437 Sep 22 15:02:56.345136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 357/695] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:02:56.976993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:56.977613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:56.987839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:56.987839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:56.987839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:56.987839 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:56.988880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:56.988880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:57.134791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:57.147928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:57.149724 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:57.151123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1148aacb-dd7d-4b56-a92f-cd9c40cd0673 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1406 microversion: 2.20 time: 0.178163 Sep 22 15:02:57.151768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 339/696] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:56 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:58.181317 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:58.182009 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:58.189928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:58.191266 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:58.191708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:58.192399 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:58.193679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:58.194103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:58.566792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:58.575485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:58.576944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:58.578050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a6096917-d160-4583-8fbc-4ecdb937bb14 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1406 microversion: 2.20 time: 0.401271 Sep 22 15:02:58.578620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 358/697] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:58 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:59.603060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:59.603679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:59.606125 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:02:59.611520 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:59.612008 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:59.612443 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:59.613130 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:59.613583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:59.614006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:59.744329 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:59.753049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:59.754501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:02:59.755705 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1d12c4a4-6f9a-4db4-9711-2f24b8523bc7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1598 microversion: 2.20 time: 0.156627 Sep 22 15:02:59.756261 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 340/698] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:02:59 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:02:59.779534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:02:59.780044 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:02:59.786287 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:59.786805 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:59.787241 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:59.787921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:02:59.788368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:02:59.788784 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:02:59.872707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cee70784-eb85-46dd-abc8-1af54f1235fb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096963 Sep 22 15:02:59.873309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 359/699] 10.222.0.26 () {60 vars in 1316 bytes} [Thu Sep 22 15:02:59 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 15:03:00.792383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-b4b5b3d7-28aa-4aca-8810-426cca360754 req-71c25f34-a699-4108-bd44-6f5a6194bdfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25eaa6dc-ecc8-44ac-a552-9753ed98baa4", "tag": "2a4fb816-a034-43e4-973a-90bfa5151681"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:00.797917 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:00.804881 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b4b5b3d7-28aa-4aca-8810-426cca360754 req-71c25f34-a699-4108-bd44-6f5a6194bdfd service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:00.805393 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b4b5b3d7-28aa-4aca-8810-426cca360754 req-71c25f34-a699-4108-bd44-6f5a6194bdfd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:00.805823 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b4b5b3d7-28aa-4aca-8810-426cca360754 req-71c25f34-a699-4108-bd44-6f5a6194bdfd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:00.817463 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-b4b5b3d7-28aa-4aca-8810-426cca360754 req-71c25f34-a699-4108-bd44-6f5a6194bdfd service nova] Creating event network-changed:2a4fb816-a034-43e4-973a-90bfa5151681 for instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 on hv-cinder-84456 Sep 22 15:03:00.822445 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-b4b5b3d7-28aa-4aca-8810-426cca360754 req-71c25f34-a699-4108-bd44-6f5a6194bdfd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034434 Sep 22 15:03:00.823089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 341/700] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:09.534023 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:09.534702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=6 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:09.539385 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:09.539872 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:09.546863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:09.547343 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:09.547774 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:09.548462 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:09.548907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:09.549326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:09.551913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:09.830557 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lazy-loading 'services' on Instance uuid dea87b94-a17c-4cc6-b9f0-2113981000f9 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:03:09.902665 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2d24aec9-3928-4adf-b8e0-7578a46693d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-volume_attachments/c95cdb7a-460d-4e9a-9281-13b2472280e9" status: 202 len: 0 microversion: 2.1 time: 0.369255 Sep 22 15:03:09.906404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 360/701] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:03:09 2022] DELETE /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-volume_attachments/c95cdb7a-460d-4e9a-9281-13b2472280e9 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:03:11.024697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:11.025637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:11.031264 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a8f77294-5461-4887-aac2-4c4fab46a411 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:11.039242 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8f77294-5461-4887-aac2-4c4fab46a411 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:11.039734 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8f77294-5461-4887-aac2-4c4fab46a411 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:11.040168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a8f77294-5461-4887-aac2-4c4fab46a411 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:11.066396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a8f77294-5461-4887-aac2-4c4fab46a411 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Going to try to stop instance {{(pid=120695) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 15:03:11.115455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a8f77294-5461-4887-aac2-4c4fab46a411 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action" status: 202 len: 0 microversion: 2.1 time: 0.091966 Sep 22 15:03:11.116523 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 342/702] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:03:11 2022] POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:03:11.127486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:11.128570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:11.137114 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:11.137644 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:11.138146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:11.138886 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:11.139337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:11.139758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:11.277519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:11.285061 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ac8d142d-4f2f-4b48-b4d3-45fe404f6af5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.164493 Sep 22 15:03:11.285617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 361/703] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:11 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:12.309615 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:12.310225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:12.316380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:12.316851 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:12.317277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:12.317959 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:12.318404 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:12.318845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:12.553565 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:12.561412 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4a9dd9d5-503f-48bd-b6c6-583b10c824f6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.256541 Sep 22 15:03:12.561917 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 343/704] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:12 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:13.584859 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:13.585471 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:13.592818 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:13.593302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:13.593737 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:13.594435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:13.594958 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:13.595352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:13.727138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:13.735363 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-28ab5b59-040b-42bb-abb1-d90c8050c644 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.154373 Sep 22 15:03:13.735932 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 362/705] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:13 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:14.124513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:14.125060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:14.131565 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:14.132044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:14.132476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:14.133165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:14.133609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:14.134025 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:14.157712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7e63e62c-ff48-4ec7-9f86-95cd552eb345 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/ips" status: 200 len: 149 microversion: 2.1 time: 0.037077 Sep 22 15:03:14.158279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 344/706] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:03:14 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:14.758999 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:14.759620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:14.765907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:14.766393 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:14.766858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:14.767563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:14.768013 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:14.768651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:14.898870 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:14.906549 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7697c8f9-ae57-4bfb-a329-79bc20968468 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.151943 Sep 22 15:03:14.907134 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 363/707] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:14 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:15.483857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:15.484352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:15.490942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.491365 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.491783 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56a0a1d6-e423-469d-8fef-1851689dfcc2"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:15.491942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:15.492484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.492937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.493359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:15.494253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:15.500279 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.500756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.501183 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:15.501881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.502404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.502857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:15.581675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lazy-loading 'services' on Instance uuid 0cd72afb-0e38-47ae-a54e-2667b786a75b {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:03:15.659999 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ee84216a-3b09-4a88-adb2-e78e3118c8bb tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments/faf8502c-c0e8-4330-a969-1ecb5845c941" status: 202 len: 0 microversion: 2.1 time: 0.179837 Sep 22 15:03:15.660822 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 345/708] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:03:15 2022] DELETE /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments/faf8502c-c0e8-4330-a969-1ecb5845c941 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:03:15.670244 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:15.673157 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:15.682372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.683405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.683923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:15.684720 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.685230 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.685719 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:15.722045 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-876eaf0e-b52c-4b31-8aca-7b01968b21c0 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056220 Sep 22 15:03:15.722598 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 346/709] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:03:15 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:03:15.768454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9ebf81fe-2d9c-4a58-9624-4d42fbce4d6d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280372 Sep 22 15:03:15.769348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 364/710] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:03:15 2022] POST /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:03:15.930351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:15.930980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:15.937500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.937972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.938407 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:15.939112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:15.939562 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:15.939980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:16.069395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:16.077755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f788a1fa-4d39-44e1-9f65-db4d00688911 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.151327 Sep 22 15:03:16.078308 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 347/711] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:15 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:16.837638 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:16.841130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:16.847590 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:16.848172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:16.848509 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:16.849208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:16.850087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:16.850087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:16.884719 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e1aae9de-8e39-43be-aa31-7d2b4b277b5a tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153852 Sep 22 15:03:16.885276 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 365/712] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:03:16 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 15:03:16.962576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:16.963111 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:16.970020 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:16.970504 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:16.970974 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:16.971675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:16.972131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:16.972557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:16.997820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:03:17.072467 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-48cd260c-a2e3-4086-b3f5-34363ed2f6ab tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 204 len: 0 microversion: 2.1 time: 0.113803 Sep 22 15:03:17.073030 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 348/713] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:03:16 2022] DELETE /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:03:17.082853 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:17.083442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:17.093342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:17.094020 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:17.094575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:17.095493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:17.096099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:17.096667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:17.101987 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:17.102686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:17.108727 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:17.109206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:17.109632 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:17.110325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:17.110794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:17.111216 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:17.294981 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:17.297971 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:17.302740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1decd625-aa84-492f-b900-ff81a50f7d38 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1688 microversion: 2.1 time: 0.224657 Sep 22 15:03:17.303385 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 366/714] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:17 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1688 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:17.305648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cf0d4b7c-4c4b-421b-bbe5-f29d7b7d6aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.208056 Sep 22 15:03:17.309384 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 349/715] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:17 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:03:18.327168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:18.327962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:18.329423 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:18.330036 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:18.334455 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:18.334968 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:18.335402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:18.336348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:18.336634 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:18.336781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:18.337114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:18.337225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:18.337543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:18.338231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:18.338682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:18.339142 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:18.529397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:18.536518 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:18.536997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f8f50f39-4159-4904-88eb-40c097df9c33 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1688 microversion: 2.1 time: 0.213807 Sep 22 15:03:18.537578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 367/716] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:18 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:18.548978 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2b818e4b-4466-4f1d-b5fd-154e40b9bb24 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.219591 Sep 22 15:03:18.548978 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 350/717] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:18 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:03:19.560367 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:19.560978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:19.567441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:19.567956 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:19.568088 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:19.568307 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:19.568740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:19.569440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:19.569896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:19.570317 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:19.574647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:19.575218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:19.575689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:19.576351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:19.576806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:19.577228 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:19.762126 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:19.770052 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1e8544ce-3f38-44cd-876f-9d9c9afa9ba6 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1688 microversion: 2.1 time: 0.213518 Sep 22 15:03:19.770832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 368/718] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:19 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1688 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:19.773832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:19.782137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b39e12e7-3132-427c-91d8-e1400564aabd tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.218502 Sep 22 15:03:19.782799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 351/719] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:19 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:20.794214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:20.794841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:20.801249 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:20.801728 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:20.802160 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:20.802883 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:20.803334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:20.803758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:20.806388 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:20.807016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:20.813002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:20.813582 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:20.814087 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:20.814885 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:20.815413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:20.815911 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:21.002197 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:21.010807 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1558669f-86cd-49a4-a277-6967bc762b8e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1688 microversion: 2.1 time: 0.220351 Sep 22 15:03:21.011681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 369/720] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:20 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:21.016821 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:21.025757 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fa38958d-951d-4ed6-b9c0-8b944ec214e5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1679 microversion: 2.1 time: 0.224093 Sep 22 15:03:21.026751 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 352/721] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:20 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:03:21.362760 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-c8c769f0-af54-47ce-aeaa-ef24c648ad1c req-d6d422d7-d726-4ba3-b4d5-2ccfeb883692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd72afb-0e38-47ae-a54e-2667b786a75b", "name": "network-vif-deleted", "tag": "643356c5-34f7-492b-a963-cdc7638a5c5a"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:21.372867 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8c769f0-af54-47ce-aeaa-ef24c648ad1c req-d6d422d7-d726-4ba3-b4d5-2ccfeb883692 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:21.380596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8c769f0-af54-47ce-aeaa-ef24c648ad1c req-d6d422d7-d726-4ba3-b4d5-2ccfeb883692 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:21.381179 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c8c769f0-af54-47ce-aeaa-ef24c648ad1c req-d6d422d7-d726-4ba3-b4d5-2ccfeb883692 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:21.393684 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-c8c769f0-af54-47ce-aeaa-ef24c648ad1c req-d6d422d7-d726-4ba3-b4d5-2ccfeb883692 service nova] Creating event network-vif-deleted:643356c5-34f7-492b-a963-cdc7638a5c5a for instance 0cd72afb-0e38-47ae-a54e-2667b786a75b on hv-cinder-84456 Sep 22 15:03:21.398559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-c8c769f0-af54-47ce-aeaa-ef24c648ad1c req-d6d422d7-d726-4ba3-b4d5-2ccfeb883692 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039491 Sep 22 15:03:21.399222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 370/722] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:22.036272 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:22.036819 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:22.044031 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.044804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.045418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.046312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.046973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.047400 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.051470 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:22.052768 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:22.059183 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.059670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.060095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.060789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.061546 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.061986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.080926 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.080926 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.081229 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.081648 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lazy-loading 'fault' on Instance uuid 0cd72afb-0e38-47ae-a54e-2667b786a75b {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:03:22.158225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:22.167287 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-93ea0e3c-3f6d-4756-adff-3d6d96ab44e5 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 200 len: 1335 microversion: 2.1 time: 0.134919 Sep 22 15:03:22.167902 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 353/723] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:22 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:22.228485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:22.239278 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4b298e99-abd8-40cb-8d8e-d044cf5fafa5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1656 microversion: 2.1 time: 0.192815 Sep 22 15:03:22.239860 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 371/724] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:22 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1656 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:22.262516 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1b96ddd1-5e03-438d-9af6-225d5419cc74 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:22.269129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b96ddd1-5e03-438d-9af6-225d5419cc74 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.269620 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b96ddd1-5e03-438d-9af6-225d5419cc74 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.270049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b96ddd1-5e03-438d-9af6-225d5419cc74 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.298966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1b96ddd1-5e03-438d-9af6-225d5419cc74 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Going to try to start instance {{(pid=120695) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 15:03:22.317892 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:22.350505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1b96ddd1-5e03-438d-9af6-225d5419cc74 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action" status: 202 len: 0 microversion: 2.1 time: 0.092175 Sep 22 15:03:22.351314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 354/725] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:03:22 2022] POST /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:03:22.359551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:22.360171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:22.366045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.366535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.367091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.367792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:22.368341 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:22.368704 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:22.503807 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:22.511639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-854d2f16-d865-4d84-9569-833c84134848 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1665 microversion: 2.1 time: 0.155991 Sep 22 15:03:22.512715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 372/726] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:22 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:23.187974 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 15:03:23.188522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Thu Sep 22 15:03:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b (ip 10.222.0.26) !!! Sep 22 15:03:23.199324 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:23.200036 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 0cd72afb-0e38-47ae-a54e-2667b786a75b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:23.207042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.207490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.207930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.208633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.209092 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.209744 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.223260 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] HTTP exception thrown: Instance 0cd72afb-0e38-47ae-a54e-2667b786a75b could not be found. Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Request method failure captured: Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b HTTP/1.1 Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgIMz35eZr-TOgMxIor3-RJ8UB8GkoNCikvHlilSlMfG3f6kIoqDS7rJu8k1SCoFhaU2Z5UUxc8E7pBOqBA8xmEsBh1JbrbP_k6qe6D8aiGRIwVEJsvd44JjqAqER7hoFNvQMs6kahtDcRFKgXq2Dx6AdJ4k9iRk-nXcA-qn1K-cps Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:23.224898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 038365d6ba7041f4af386767d98ed709 Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 0cd72afb-0e38-47ae-a54e-2667b786a75b could not be found. Sep 22 15:03:23.226535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '0cd72afb-0e38-47ae-a54e-2667b786a75b'} Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd72afb-0e38-47ae-a54e-2667b786a75b could not be found. Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:23.227358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd72afb-0e38-47ae-a54e-2667b786a75b could not be found. Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd72afb-0e38-47ae-a54e-2667b786a75b could not be found. Sep 22 15:03:23.228787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.230070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Returning 404 to user: Instance 0cd72afb-0e38-47ae-a54e-2667b786a75b could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:23.230070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ca67fefa-ed21-4488-b028-ef14001db992 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b" status: 404 len: 111 microversion: 2.1 time: 0.039715 Sep 22 15:03:23.230070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 355/727] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:23 2022] GET /compute/v2.1/servers/0cd72afb-0e38-47ae-a54e-2667b786a75b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:03:23.235572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-22f28027-1466-42ca-a29a-62202fa4d9e7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '.version_select at 0x7f77e62bf670>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:23.255157 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-22f28027-1466-42ca-a29a-62202fa4d9e7 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566355206" status: 202 len: 0 microversion: 2.1 time: 0.023294 Sep 22 15:03:23.255842 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 373/728] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 22 15:03:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1566355206 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:03:23.423835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56a0a1d6-e423-469d-8fef-1851689dfcc2"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:23.426555 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:23.432600 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.433074 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.433996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.434684 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.435162 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.435583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.522799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Invalid volume: volume 56a0a1d6-e423-469d-8fef-1851689dfcc2 is already attached to instances: a4ac3fbb-deaf-4c39-9620-7db9ced29124 Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments HTTP/1.1 Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 74 Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:23.524429 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {"volumeAttachment": {"volumeId": "56a0a1d6-e423-469d-8fef-1851689dfcc2"}} Sep 22 15:03:23.525965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Invalid volume: volume 56a0a1d6-e423-469d-8fef-1851689dfcc2 is already attached to instances: a4ac3fbb-deaf-4c39-9620-7db9ced29124 Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'server_id': 'a4ac3fbb-deaf-4c39-9620-7db9ced29124', 'body': {'volumeAttachment': {'volumeId': '56a0a1d6-e423-469d-8fef-1851689dfcc2'}}} Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 56a0a1d6-e423-469d-8fef-1851689dfcc2 is already attached to instances: a4ac3fbb-deaf-4c39-9620-7db9ced29124 Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.527879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 56a0a1d6-e423-469d-8fef-1851689dfcc2 is already attached to instances: a4ac3fbb-deaf-4c39-9620-7db9ced29124 Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:23.529179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 56a0a1d6-e423-469d-8fef-1851689dfcc2 is already attached to instances: a4ac3fbb-deaf-4c39-9620-7db9ced29124 Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 400 to user: Invalid volume: volume 56a0a1d6-e423-469d-8fef-1851689dfcc2 is already attached to instances: a4ac3fbb-deaf-4c39-9620-7db9ced29124 {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bd57f3a4-d077-47b4-88da-dfc3e29e853a tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106115 Sep 22 15:03:23.530629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 356/729] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:03:23 2022] POST /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:03:23.537376 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:23.538060 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:23.547285 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.547668 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.548115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.548845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.549304 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.549731 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.609389 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:23.610180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:23.618000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.618820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.619423 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.620349 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.620810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.621272 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.714221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lazy-loading 'services' on Instance uuid a4ac3fbb-deaf-4c39-9620-7db9ced29124 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:03:23.719104 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:23.727390 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0cc748de-a061-44cf-92dd-dcdfe0e15a46 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1665 microversion: 2.1 time: 0.193915 Sep 22 15:03:23.728124 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 374/730] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:23 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1665 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:23.790566 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b4f7300f-6b0c-470d-a7ad-9dcc303d87aa tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments/56a0a1d6-e423-469d-8fef-1851689dfcc2" status: 202 len: 0 microversion: 2.1 time: 0.185817 Sep 22 15:03:23.791214 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 357/731] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:03:23 2022] DELETE /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments/56a0a1d6-e423-469d-8fef-1851689dfcc2 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:03:23.800027 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:23.802224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:23.809035 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.809547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.809963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.810682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:23.811173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:23.811603 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:23.842172 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4cde2572-3415-4a4b-88ee-4f05f0bf0b9b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046006 Sep 22 15:03:23.842919 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 375/732] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:03:23 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:24.753634 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:24.754332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:24.761047 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:24.761562 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:24.761995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:24.762686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:24.763160 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:24.763583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:24.855021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:24.858605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:24.862534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:24.866642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:24.867161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:24.867592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:24.868476 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:24.868931 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:24.869351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:24.885611 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:24.902865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:24.908229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e014ea9b-ed2e-4996-81dc-d5dca7744b8d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057120 Sep 22 15:03:24.908810 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 376/733] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:03:24 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 15:03:24.914241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6e77433f-bf0d-4190-8b6c-87ca9d177161 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1669 microversion: 2.1 time: 0.162858 Sep 22 15:03:24.914241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 358/734] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:24 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:24.973671 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:24.974170 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:24.980076 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:24.981130 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:24.981564 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:24.982600 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:24.982721 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:24.983146 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:25.008685 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:03:25.083847 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-42d6cf34-03b8-40c4-a76f-cdd415162ac7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 204 len: 0 microversion: 2.1 time: 0.113687 Sep 22 15:03:25.084474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 359/735] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:03:24 2022] DELETE /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:03:25.095514 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:25.095665 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:25.103145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:25.104021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:25.104640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:25.105948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:25.106694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:25.107047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:25.237180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:25.246104 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0b01fdc6-a104-4ec6-bfb3-76f3a14e1c30 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1680 microversion: 2.1 time: 0.156556 Sep 22 15:03:25.246896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 377/736] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:25 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:26.269985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:26.270684 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:26.277592 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:26.278070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:26.278501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:26.279219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:26.279673 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:26.280092 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:26.408309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:26.408792 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:26.408917 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:26.415413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:26.415893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:26.416321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:26.416607 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fbea5bad-5b37-4914-99a8-6176ca4f3ac0 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1680 microversion: 2.1 time: 0.150852 Sep 22 15:03:26.417011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:26.417333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 360/737] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:26 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:26.417483 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:26.418557 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:26.445967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Going to try to terminate instance {{(pid=120694) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:03:26.534838 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9204fbef-a385-4121-91c2-4605bb79ce88 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 204 len: 0 microversion: 2.1 time: 0.129952 Sep 22 15:03:26.535496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 378/738] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:03:26 2022] DELETE /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 15:03:26.545403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:26.546120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:26.553745 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:26.554245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:26.554681 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:26.555414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:26.555898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:26.556987 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:26.696966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:26.705096 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0f24a520-3c46-4e14-9d98-584a2aa720d3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1506 microversion: 2.1 time: 0.164629 Sep 22 15:03:26.705657 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 361/739] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:26 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:27.440945 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:27.441646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:27.448079 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:27.448566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:27.449003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:27.449700 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:27.450155 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:27.450583 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:27.579151 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:27.587409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-54732d48-8e13-4614-ad19-68be96653845 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1680 microversion: 2.1 time: 0.150673 Sep 22 15:03:27.587983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 379/740] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:27 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:27.728167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:27.728760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:27.735742 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:27.736213 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:27.736640 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:27.737323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:27.737768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:27.738186 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:27.865351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:27.873239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-24037510-1bba-45df-891b-93ac7973fa9e tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1506 microversion: 2.1 time: 0.148900 Sep 22 15:03:27.873812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 362/741] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:27 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:28.612085 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:28.612631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:28.619211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:28.619705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:28.620146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:28.621370 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:28.621813 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:28.622241 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:28.752018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:28.760755 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-56e711f0-9838-4ee9-b0c6-422ed99839d7 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1680 microversion: 2.1 time: 0.152784 Sep 22 15:03:28.761862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 380/742] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:28 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:28.897414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:28.897960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:28.904421 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:28.904913 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:28.905352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:28.906056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:28.906514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:28.906968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:29.046023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:29.054567 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b25bf705-32ca-4fd3-bbc9-b7e61e79b653 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1506 microversion: 2.1 time: 0.160904 Sep 22 15:03:29.055351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 363/743] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:28 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:29.759456 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-f4c6833c-f3c9-40b5-9311-03fcd20238a5 req-7463f147-2ecf-499a-8116-2414569ae36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9275db0b-6903-400e-a766-1cb9effeedf1", "name": "network-vif-deleted", "tag": "03ac6268-6935-466d-836e-bd953370c34d"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:29.772708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f4c6833c-f3c9-40b5-9311-03fcd20238a5 req-7463f147-2ecf-499a-8116-2414569ae36a service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:29.773203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f4c6833c-f3c9-40b5-9311-03fcd20238a5 req-7463f147-2ecf-499a-8116-2414569ae36a service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:29.773625 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-f4c6833c-f3c9-40b5-9311-03fcd20238a5 req-7463f147-2ecf-499a-8116-2414569ae36a service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:29.786138 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:29.787014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-f4c6833c-f3c9-40b5-9311-03fcd20238a5 req-7463f147-2ecf-499a-8116-2414569ae36a service nova] Creating event network-vif-deleted:03ac6268-6935-466d-836e-bd953370c34d for instance 9275db0b-6903-400e-a766-1cb9effeedf1 on hv-cinder-84456 Sep 22 15:03:29.787454 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:29.793144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-f4c6833c-f3c9-40b5-9311-03fcd20238a5 req-7463f147-2ecf-499a-8116-2414569ae36a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037287 Sep 22 15:03:29.794272 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 381/744] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:29.795077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:29.795558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:29.796086 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:29.796860 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:29.797382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:29.797874 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:29.871359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:29.880197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fd27b092-c406-4ac5-bedd-6e944ef1b203 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 200 len: 1613 microversion: 2.1 time: 0.099280 Sep 22 15:03:29.880770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 364/745] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:29 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 1613 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:30.082568 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:30.083634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:30.092844 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:30.093983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:30.094747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:30.095916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:30.096586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:30.097216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:30.149600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:30.150019 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:30.150555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:30.151043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lazy-loading 'fault' on Instance uuid 9275db0b-6903-400e-a766-1cb9effeedf1 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:03:30.205761 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:30.213783 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e22a1ac7-9d75-4bca-bfa5-bcb34928cbaa tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 200 len: 1311 microversion: 2.1 time: 0.136679 Sep 22 15:03:30.214937 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 382/746] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:30 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:30.906077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:30.906697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:30.914570 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:30.915368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:30.915811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:30.916535 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:30.917149 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:30.918498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:30.933918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 HTTP/1.1 Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:30.935998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:03:30.938279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'a4ac3fbb-deaf-4c39-9620-7db9ced29124'} Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:30.939965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:03:30.941151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:30.944355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:30.944355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c4a97e53-6497-4d28-9d84-4252141c66ca tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 404 len: 111 microversion: 2.1 time: 0.036158 Sep 22 15:03:30.944355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 365/747] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:30 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:03:30.946927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4481d312-9f96-42a4-b9d4-890d702a4029 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '.version_select at 0x7f77e62e2790>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:30.968374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4481d312-9f96-42a4-b9d4-890d702a4029 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095460558" status: 202 len: 0 microversion: 2.1 time: 0.025454 Sep 22 15:03:30.968955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 383/748] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 22 15:03:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095460558 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 15:03:31.238846 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:31.239384 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 9275db0b-6903-400e-a766-1cb9effeedf1] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:31.245701 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:31.246190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:31.246623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:31.247354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:31.247806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:31.248223 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:31.262876 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] HTTP exception thrown: Instance 9275db0b-6903-400e-a766-1cb9effeedf1 could not be found. Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Request method failure captured: Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 HTTP/1.1 Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgIMz35eZr-TOgMxIor3-RJ8UB8GkoNCikvHlilSlMfG3f6kIoqDS7rJu8k1SCoFhaU2Z5UUxc8E7pBOqBA8xmEsBh1JbrbP_k6qe6D8aiGRIwVEJsvd44JjqAqER7hoFNvQMs6kahtDcRFKgXq2Dx6AdJ4k9iRk-nXcA-qn1K-cps Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:31.264451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 038365d6ba7041f4af386767d98ed709 Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 9275db0b-6903-400e-a766-1cb9effeedf1 could not be found. Sep 22 15:03:31.266056 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '9275db0b-6903-400e-a766-1cb9effeedf1'} Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9275db0b-6903-400e-a766-1cb9effeedf1 could not be found. Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:31.266995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9275db0b-6903-400e-a766-1cb9effeedf1 could not be found. Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9275db0b-6903-400e-a766-1cb9effeedf1 could not be found. Sep 22 15:03:31.268476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:31.270151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Returning 404 to user: Instance 9275db0b-6903-400e-a766-1cb9effeedf1 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:31.270151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2f0eeb12-766a-4ad3-98f1-dba03747c4e3 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1" status: 404 len: 111 microversion: 2.1 time: 0.031082 Sep 22 15:03:31.270151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 366/749] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:31 2022] GET /compute/v2.1/servers/9275db0b-6903-400e-a766-1cb9effeedf1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:03:31.275629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:31.276132 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:31.282854 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:31.283342 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:31.283783 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:31.284485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:31.284942 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:31.285373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:31.312431 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Going to try to terminate instance {{(pid=120694) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:03:31.393820 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-03048a13-af4e-48b4-a40a-f109cf9e2d90 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 204 len: 0 microversion: 2.1 time: 0.121774 Sep 22 15:03:31.394835 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 384/750] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:03:31 2022] DELETE /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:03:31.403783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:31.404490 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:31.410426 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:31.410944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:31.411683 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:31.412537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:31.412984 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:31.413411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:31.552643 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:31.560474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1dfc645b-3573-4045-acf7-0cf3c5122718 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.161717 Sep 22 15:03:31.561032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 367/751] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:31 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:31.598827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-305dfee6-29c7-41af-848c-d32729d5fffe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: .version_select at 0x7f77e62e2820>, body: {"keypair": {"name": "tempest-keypair-1664219446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjuThXI508+YPDoKIipk75HBibidp45yrmG22ynhgcbi787KjLEkbiFOkbHQZt/R+uuM8wgchi66baYUIOJbvlaT4OB58f3HtOMACrIKW/FVK5vztb0O/PMRUxF20YV+g=="}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:31.614562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-305dfee6-29c7-41af-848c-d32729d5fffe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:03:31.618298 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-305dfee6-29c7-41af-848c-d32729d5fffe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:03:31.639686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-305dfee6-29c7-41af-848c-d32729d5fffe tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046396 Sep 22 15:03:31.640379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 385/752] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:03:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:31.838331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-42ff3dc7-9323-4a5a-ae4d-fe0c41ee113c req-3e528155-5fac-40f2-8dff-549d87b97d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ac3fbb-deaf-4c39-9620-7db9ced29124", "name": "network-vif-deleted", "tag": "46a5eff0-933d-41e2-9be3-6fbcac079d57"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:31.848342 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-42ff3dc7-9323-4a5a-ae4d-fe0c41ee113c req-3e528155-5fac-40f2-8dff-549d87b97d89 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:31.848817 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-42ff3dc7-9323-4a5a-ae4d-fe0c41ee113c req-3e528155-5fac-40f2-8dff-549d87b97d89 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:31.849248 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-42ff3dc7-9323-4a5a-ae4d-fe0c41ee113c req-3e528155-5fac-40f2-8dff-549d87b97d89 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:31.861509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-42ff3dc7-9323-4a5a-ae4d-fe0c41ee113c req-3e528155-5fac-40f2-8dff-549d87b97d89 service nova] Creating event network-vif-deleted:46a5eff0-933d-41e2-9be3-6fbcac079d57 for instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 on hv-cinder-84456 Sep 22 15:03:31.866639 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-42ff3dc7-9323-4a5a-ae4d-fe0c41ee113c req-3e528155-5fac-40f2-8dff-549d87b97d89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032067 Sep 22 15:03:31.867281 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 368/753] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:32.584914 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:32.585636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:32.592151 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:32.592637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:32.593062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:32.593758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:32.594201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:32.594617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:32.728748 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:32.737275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-911a5636-0914-4283-8454-8ac32167a196 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.156714 Sep 22 15:03:32.738224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 386/754] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:32 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:32.874386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1302510937", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff6bd501-2fb8-4ba1-b730-2cab6c908602"}], "security_groups": [{"name": "tempest-securitygroup--837725161"}], "key_name": "tempest-keypair-1664219446", "user_data": "}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:32.975467 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] validate_networks() for [('ff6bd501-2fb8-4ba1-b730-2cab6c908602', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:03:33.382430 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:03:33.382925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:03:33.383403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:03:33.383814 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:03:33.384225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:03:33.393509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:33.393988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:33.394425 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:33.395182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:33.395636 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:33.396062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:33.413155 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:03:33.417141 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Getting quotas for user f298f0c6a9e44efba2a1e2fc648a0f5d and project dc8a4487033d4e4aa231cc5873def0cf. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:03:33.428015 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:03:33.430402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:03:33.478372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-eba9d360-fed2-43a8-b637-ec9442121fe1 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.609848 Sep 22 15:03:33.479052 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 369/755] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:03:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:03:33.490004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-af58cfd7-0f48-4ce5-8826-3f1cae20b23f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:33.490621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-af58cfd7-0f48-4ce5-8826-3f1cae20b23f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:33.543508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-af58cfd7-0f48-4ce5-8826-3f1cae20b23f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:33.550607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-af58cfd7-0f48-4ce5-8826-3f1cae20b23f tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1242 microversion: 2.1 time: 0.064375 Sep 22 15:03:33.551223 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 387/756] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:33 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:33.760158 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:33.760794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:33.767032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:33.767506 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:33.767932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:33.768611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:33.769087 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:33.769500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:33.907531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:33.915462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3a416137-4b03-4c34-b3dd-33acb906e9c4 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.159231 Sep 22 15:03:33.916117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 370/757] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:33 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:34.574373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:34.574991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:34.581451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:34.581934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:34.582364 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:34.583105 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:34.583562 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:34.583986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:34.648488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:34.658092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-53a29da3-628b-43ee-b6b1-a85ac0d0a1fb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1238 microversion: 2.1 time: 0.088180 Sep 22 15:03:34.659097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 388/758] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:34 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:34.939484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:34.940204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:34.946777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:34.947259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:34.947693 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:34.948385 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:34.948837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:34.949261 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:35.108460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-c59e7c79-6970-4670-adc8-974b4a7956a2 req-15013e45-b2b4-4efe-a8ed-9eee57eaf205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdb9447-4895-42dd-bb76-06ef6acb90fe", "name": "network-vif-deleted", "tag": "1daa1a28-9862-4383-a61c-cba96eedcb29"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:35.111239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038365d6ba7041f4af386767d98ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a15aa877b1b482fa70f65ecd4f8d1f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:35.116381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:35.123187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c59e7c79-6970-4670-adc8-974b4a7956a2 req-15013e45-b2b4-4efe-a8ed-9eee57eaf205 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:35.123413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-13842f9a-b7f3-4e1a-83b0-8088a3a85d98 tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 200 len: 1521 microversion: 2.1 time: 0.187691 Sep 22 15:03:35.123880 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c59e7c79-6970-4670-adc8-974b4a7956a2 req-15013e45-b2b4-4efe-a8ed-9eee57eaf205 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:35.124450 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 371/759] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:34 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:35.124602 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c59e7c79-6970-4670-adc8-974b4a7956a2 req-15013e45-b2b4-4efe-a8ed-9eee57eaf205 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:35.143008 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-c59e7c79-6970-4670-adc8-974b4a7956a2 req-15013e45-b2b4-4efe-a8ed-9eee57eaf205 service nova] Creating event network-vif-deleted:1daa1a28-9862-4383-a61c-cba96eedcb29 for instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe on hv-cinder-84456 Sep 22 15:03:35.148027 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-c59e7c79-6970-4670-adc8-974b4a7956a2 req-15013e45-b2b4-4efe-a8ed-9eee57eaf205 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056747 Sep 22 15:03:35.149046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 389/760] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:03:35.685048 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:35.685675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:35.692840 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:35.693330 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:35.693807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:35.694473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:35.694968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:35.695393 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:35.762758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:35.772253 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a53cc1a0-1ba9-41d8-9ecb-cdda2b0b0e9e tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1300 microversion: 2.1 time: 0.092232 Sep 22 15:03:35.776332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 372/761] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:35 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:36.148660 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:36.150101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] [instance: 4cdb9447-4895-42dd-bb76-06ef6acb90fe] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:36.161140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:36.162053 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:36.163571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:36.164930 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:36.165405 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:36.165834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:36.182066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] HTTP exception thrown: Instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe could not be found. Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Request method failure captured: Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe HTTP/1.1 Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgIMz35eZr-TOgMxIor3-RJ8UB8GkoNCikvHlilSlMfG3f6kIoqDS7rJu8k1SCoFhaU2Z5UUxc8E7pBOqBA8xmEsBh1JbrbP_k6qe6D8aiGRIwVEJsvd44JjqAqER7hoFNvQMs6kahtDcRFKgXq2Dx6AdJ4k9iRk-nXcA-qn1K-cps Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:03:36.183747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6a15aa877b1b482fa70f65ecd4f8d1f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 6a15aa877b1b482fa70f65ecd4f8d1f3 Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2007241858 Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 038365d6ba7041f4af386767d98ed709 Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2007241858-project Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe could not be found. Sep 22 15:03:36.185054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '4cdb9447-4895-42dd-bb76-06ef6acb90fe'} Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe could not be found. Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:36.185811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe could not be found. Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe could not be found. Sep 22 15:03:36.187012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:03:36.188144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] Returning 404 to user: Instance 4cdb9447-4895-42dd-bb76-06ef6acb90fe could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:36.188144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a12a0b38-2a77-4e1d-aaaf-88a3ae078ebe tempest-ServerRescueNegativeTestJSON-2007241858 tempest-ServerRescueNegativeTestJSON-2007241858-project] 10.222.0.26 "GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe" status: 404 len: 111 microversion: 2.1 time: 0.041043 Sep 22 15:03:36.189425 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 390/762] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:36 2022] GET /compute/v2.1/servers/4cdb9447-4895-42dd-bb76-06ef6acb90fe => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:03:36.796804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:36.797431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:36.804302 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:36.804782 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:36.805242 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:36.805947 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:36.806401 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:36.806857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:36.948728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:36.957239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d8e3f355-9875-4f78-861c-dec70398ac19 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.164434 Sep 22 15:03:36.957811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 373/763] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:36 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:36.991993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:36.992490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:36.998974 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:36.999453 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:36.999885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:37.000566 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:37.001021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:37.001422 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:37.025782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a9dcfae1-89cf-4d1e-b9dd-2b77844d6ca7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/ips" status: 200 len: 152 microversion: 2.20 time: 0.147572 Sep 22 15:03:37.026338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 391/764] 10.222.0.26 () {60 vars in 1289 bytes} [Thu Sep 22 15:03:36 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/ips => generated 152 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 15:03:37.458439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-d42dca16-f376-49d2-be49-396ab211135b req-1c9ea352-f566-436c-bd8a-806ee2cf96ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3591de7f-0312-4d50-8be9-b965fb09e050", "tag": "ee13107d-dc99-4ace-8561-204bb89c889f"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:37.472139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d42dca16-f376-49d2-be49-396ab211135b req-1c9ea352-f566-436c-bd8a-806ee2cf96ea service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:37.472476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d42dca16-f376-49d2-be49-396ab211135b req-1c9ea352-f566-436c-bd8a-806ee2cf96ea service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:37.472976 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-d42dca16-f376-49d2-be49-396ab211135b req-1c9ea352-f566-436c-bd8a-806ee2cf96ea service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:37.484729 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-d42dca16-f376-49d2-be49-396ab211135b req-1c9ea352-f566-436c-bd8a-806ee2cf96ea service nova] Creating event network-changed:ee13107d-dc99-4ace-8561-204bb89c889f for instance 3591de7f-0312-4d50-8be9-b965fb09e050 on hv-cinder-84456 Sep 22 15:03:37.490585 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-d42dca16-f376-49d2-be49-396ab211135b req-1c9ea352-f566-436c-bd8a-806ee2cf96ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037196 Sep 22 15:03:37.491212 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 374/765] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:37.980507 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:37.981827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:37.989846 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:37.990463 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:37.990944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:37.991643 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:37.992095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:37.993004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:38.131018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:38.138925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9bd6f0e2-f5de-4eeb-b911-30838f13a4af tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.162200 Sep 22 15:03:38.140108 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 392/766] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:37 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:39.162936 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:39.164233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:39.172043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:39.172788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:39.173224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:39.173920 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:39.174396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:39.174838 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:39.325448 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:39.334505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9053f252-c279-46de-b37a-3f1a23b4a594 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.175608 Sep 22 15:03:39.334898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 375/767] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:39 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:39.640690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:39.642866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:39.649642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:39.650401 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:39.650989 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:39.652568 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:39.654182 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:39.654977 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:39.696918 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lazy-loading 'flavor' on Instance uuid 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:03:39.736894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:39.899502 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6c03d971-c0e0-4729-9bda-9cd0ccb75929 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/action" status: 202 len: 0 microversion: 2.20 time: 0.263238 Sep 22 15:03:39.904616 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 393/768] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 22 15:03:39 2022] POST /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:03:39.911405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:39.912295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:39.915600 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:39.919258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:39.919754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:39.920245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:39.921955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:39.922656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:39.923114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:40.067348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:40.077066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:40.078950 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:40.080532 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5bd8d766-f4af-4185-962a-a271493d2107 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.174239 Sep 22 15:03:40.081271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 376/769] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:39 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:40.358251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:40.359091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:40.365635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:40.366348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:40.367041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:40.368228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:40.369703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:40.370577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:40.568305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:40.576632 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-57bc0478-f2b5-41bc-90ae-1ae491d8a807 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.222609 Sep 22 15:03:40.577634 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 394/770] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:40 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:41.108792 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:41.109469 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:41.116081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:41.116570 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:41.117008 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:41.117712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:41.118168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:41.118592 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:41.324218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:41.333820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:41.335514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:41.336939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-974529b6-38d8-4a98-a196-a6bf78bc31fe tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.232169 Sep 22 15:03:41.337764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 377/771] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:41 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:41.601474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:41.602085 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:41.609283 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:41.609765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:41.610202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:41.610924 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:41.611564 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:41.611991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:41.749165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:41.756874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-86760e50-5887-40f3-85fe-c261bddd9d38 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.159181 Sep 22 15:03:41.757534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 395/772] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:41 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:42.363850 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:42.364426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:42.370815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:42.371543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:42.371983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:42.372691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:42.373149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:42.373681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:42.380235 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-796c6158-214b-47d0-8a58-65767d54f158 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Action: 'create', calling method: .version_select at 0x7f77e61d2160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-343022496", "metadata": {"Type": "work"}}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-796c6158-214b-47d0-8a58-65767d54f158 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Request method failure captured: Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 121 Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHlOKCqv6CndN_imcThvlQVsFL0gDO1ZdrK2qowBdh0yayNGw4yOx4aAYVHV0GG3TVdS1tu6A72O5C0hAXvrOjJLaJnpcX-qHmVfLW83Gj5TSj-KrFK2HD0AYp_9lu99S3YNzZCBYDwWTrgeyv5ftlykbvsb7YO_qCyc8nQJCTiMpj0 Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:42.395521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95be18c5c5af452fb559080cff5528b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: b4ffc1e77a3047cc915afd88d4d9cd94 Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-343022496", "metadata": {"Type": "work"}}} Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 15:03:42.397023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-343022496', 'metadata': {'Type': 'work'}}}} Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise error Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi '#$%' Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:42.397845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 15:03:42.399239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 15:03:42.400402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 15:03:42.400402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.400402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-796c6158-214b-47d0-8a58-65767d54f158 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:42.400402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-796c6158-214b-47d0-8a58-65767d54f158 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137851 Sep 22 15:03:42.400402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 378/773] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 22 15:03:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:03:42.409159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-37613e4f-6c1b-43ae-85a5-9b5444fffe72 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Action: 'create', calling method: .version_select at 0x7f77e6185d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1521811052", "metadata": {"Type": "work"}}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-37613e4f-6c1b-43ae-85a5-9b5444fffe72 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Request method failure captured: Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 120 Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHlOKCqv6CndN_imcThvlQVsFL0gDO1ZdrK2qowBdh0yayNGw4yOx4aAYVHV0GG3TVdS1tu6A72O5C0hAXvrOjJLaJnpcX-qHmVfLW83Gj5TSj-KrFK2HD0AYp_9lu99S3YNzZCBYDwWTrgeyv5ftlykbvsb7YO_qCyc8nQJCTiMpj0 Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:42.413571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95be18c5c5af452fb559080cff5528b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: b4ffc1e77a3047cc915afd88d4d9cd94 Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1521811052", "metadata": {"Type": "work"}}} Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 15:03:42.414928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1521811052', 'metadata': {'Type': 'work'}}}} Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise error Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi '0' Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:42.416495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 15:03:42.418059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 15:03:42.419835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 15:03:42.419835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.419835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-37613e4f-6c1b-43ae-85a5-9b5444fffe72 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:42.419835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-37613e4f-6c1b-43ae-85a5-9b5444fffe72 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010473 Sep 22 15:03:42.419835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 379/774] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 22 15:03:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 22 15:03:42.427664 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7ab7a2a4-481a-44d1-9c2e-b483a0112f8a tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Action: 'create', calling method: .version_select at 0x7f77e6214550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1003206037", "metadata": {"Type": "work"}}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7ab7a2a4-481a-44d1-9c2e-b483a0112f8a tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Request method failure captured: Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 119 Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHlOKCqv6CndN_imcThvlQVsFL0gDO1ZdrK2qowBdh0yayNGw4yOx4aAYVHV0GG3TVdS1tu6A72O5C0hAXvrOjJLaJnpcX-qHmVfLW83Gj5TSj-KrFK2HD0AYp_9lu99S3YNzZCBYDwWTrgeyv5ftlykbvsb7YO_qCyc8nQJCTiMpj0 Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:42.431326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95be18c5c5af452fb559080cff5528b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: b4ffc1e77a3047cc915afd88d4d9cd94 Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1003206037", "metadata": {"Type": "work"}}} Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 15:03:42.432656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1003206037', 'metadata': {'Type': 'work'}}}} Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise error Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi '' Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:42.433488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 15:03:42.435439 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 15:03:42.436895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 15:03:42.436895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.436895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7ab7a2a4-481a-44d1-9c2e-b483a0112f8a tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:42.436895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7ab7a2a4-481a-44d1-9c2e-b483a0112f8a tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008794 Sep 22 15:03:42.436895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 380/775] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 22 15:03:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:03:42.444493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0910817f-6402-4a3f-a64d-e3b68e78cf63 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Calling method '.version_select at 0x7f77e616fca0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:42.476254 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-0910817f-6402-4a3f-a64d-e3b68e78cf63 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] HTTP exception thrown: Volume tempest-invalid-860233547 could not be found. Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0910817f-6402-4a3f-a64d-e3b68e78cf63 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Request method failure captured: Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-860233547 HTTP/1.1 Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHlOKCqv6CndN_imcThvlQVsFL0gDO1ZdrK2qowBdh0yayNGw4yOx4aAYVHV0GG3TVdS1tu6A72O5C0hAXvrOjJLaJnpcX-qHmVfLW83Gj5TSj-KrFK2HD0AYp_9lu99S3YNzZCBYDwWTrgeyv5ftlykbvsb7YO_qCyc8nQJCTiMpj0 Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:42.478198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95be18c5c5af452fb559080cff5528b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: b4ffc1e77a3047cc915afd88d4d9cd94 Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Volume tempest-invalid-860233547 could not be found. Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'tempest-invalid-860233547'} Sep 22 15:03:42.479623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-860233547 could not be found. (HTTP 404) (Request-ID: req-e6a96389-5ac3-4593-92fa-a3d51f938b96) Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.480557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 15:03:42.481946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-860233547 could not be found. Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:03:42.483120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-860233547 could not be found. Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-860233547 could not be found. Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0910817f-6402-4a3f-a64d-e3b68e78cf63 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Returning 404 to user: Volume tempest-invalid-860233547 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0910817f-6402-4a3f-a64d-e3b68e78cf63 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-860233547" status: 404 len: 98 microversion: 2.1 time: 0.039093 Sep 22 15:03:42.484305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 381/776] 10.222.0.26 () {58 vars in 1215 bytes} [Thu Sep 22 15:03:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-860233547 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 22 15:03:42.490310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-88db8d86-24fd-4a9e-9695-403134936245 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003712 Sep 22 15:03:42.491045 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 382/777] 10.222.0.26 () {58 vars in 1140 bytes} [Thu Sep 22 15:03:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 22 15:03:42.499741 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a39f7dd6-1668-4d1f-adda-12244b4e6094 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004059 Sep 22 15:03:42.500437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 383/778] 10.222.0.26 () {58 vars in 1137 bytes} [Thu Sep 22 15:03:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 22 15:03:42.509647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1a81fabb-8003-4c8e-9573-fa49fd4cbf51 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Calling method '.version_select at 0x7f77e61d2160>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:42.527528 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:42.537233 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:42.538685 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-1a81fabb-8003-4c8e-9573-fa49fd4cbf51 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] HTTP exception thrown: Volume 618ab6d3-7ada-4e18-8530-383c5808c7cb could not be found. Sep 22 15:03:42.539121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:42.540421 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-da0d2661-3760-4728-85bc-7566c4f3cdac tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.181651 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1a81fabb-8003-4c8e-9573-fa49fd4cbf51 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Request method failure captured: Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/os-volumes/618ab6d3-7ada-4e18-8530-383c5808c7cb HTTP/1.1 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHlOKCqv6CndN_imcThvlQVsFL0gDO1ZdrK2qowBdh0yayNGw4yOx4aAYVHV0GG3TVdS1tu6A72O5C0hAXvrOjJLaJnpcX-qHmVfLW83Gj5TSj-KrFK2HD0AYp_9lu99S3YNzZCBYDwWTrgeyv5ftlykbvsb7YO_qCyc8nQJCTiMpj0 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:42.540709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95be18c5c5af452fb559080cff5528b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: b4ffc1e77a3047cc915afd88d4d9cd94 Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Volume 618ab6d3-7ada-4e18-8530-383c5808c7cb could not be found. Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '618ab6d3-7ada-4e18-8530-383c5808c7cb'} Sep 22 15:03:42.542337 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 618ab6d3-7ada-4e18-8530-383c5808c7cb could not be found. (HTTP 404) (Request-ID: req-16d4e7c6-b1f8-4ca1-bf5a-90576543d385) Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.543536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 15:03:42.544743 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 618ab6d3-7ada-4e18-8530-383c5808c7cb could not be found. Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 15:03:42.545858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 618ab6d3-7ada-4e18-8530-383c5808c7cb could not be found. Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 618ab6d3-7ada-4e18-8530-383c5808c7cb could not be found. Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1a81fabb-8003-4c8e-9573-fa49fd4cbf51 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Returning 404 to user: Volume 618ab6d3-7ada-4e18-8530-383c5808c7cb could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1a81fabb-8003-4c8e-9573-fa49fd4cbf51 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/618ab6d3-7ada-4e18-8530-383c5808c7cb" status: 404 len: 109 microversion: 2.1 time: 0.036661 Sep 22 15:03:42.547055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 384/779] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:03:42 2022] DELETE /compute/v2.1/os-volumes/618ab6d3-7ada-4e18-8530-383c5808c7cb => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 15:03:42.553052 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7e631f82-756a-4917-a89f-673af3d126d3 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Calling method '.version_select at 0x7f77e61a7af0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:42.553989 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 396/780] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:42 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:42.581880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-7e631f82-756a-4917-a89f-673af3d126d3 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] HTTP exception thrown: Volume 51087c14-25aa-4858-90ee-3754fa38b6e2 could not be found. Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7e631f82-756a-4917-a89f-673af3d126d3 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Request method failure captured: Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/os-volumes/51087c14-25aa-4858-90ee-3754fa38b6e2 HTTP/1.1 Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHlOKCqv6CndN_imcThvlQVsFL0gDO1ZdrK2qowBdh0yayNGw4yOx4aAYVHV0GG3TVdS1tu6A72O5C0hAXvrOjJLaJnpcX-qHmVfLW83Gj5TSj-KrFK2HD0AYp_9lu99S3YNzZCBYDwWTrgeyv5ftlykbvsb7YO_qCyc8nQJCTiMpj0 Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:03:42.583955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95be18c5c5af452fb559080cff5528b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95be18c5c5af452fb559080cff5528b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 95be18c5c5af452fb559080cff5528b3 Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-VolumesNegativeTest-1606047412 Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: b4ffc1e77a3047cc915afd88d4d9cd94 Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-VolumesNegativeTest-1606047412-project Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Volume 51087c14-25aa-4858-90ee-3754fa38b6e2 could not be found. Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '51087c14-25aa-4858-90ee-3754fa38b6e2'} Sep 22 15:03:42.585315 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51087c14-25aa-4858-90ee-3754fa38b6e2 could not be found. (HTTP 404) (Request-ID: req-dea641c7-89ba-4929-ad8f-64f0bae32521) Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.586380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 15:03:42.587617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51087c14-25aa-4858-90ee-3754fa38b6e2 could not be found. Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 15:03:42.588786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51087c14-25aa-4858-90ee-3754fa38b6e2 could not be found. Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51087c14-25aa-4858-90ee-3754fa38b6e2 could not be found. Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7e631f82-756a-4917-a89f-673af3d126d3 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] Returning 404 to user: Volume 51087c14-25aa-4858-90ee-3754fa38b6e2 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7e631f82-756a-4917-a89f-673af3d126d3 tempest-VolumesNegativeTest-1606047412 tempest-VolumesNegativeTest-1606047412-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51087c14-25aa-4858-90ee-3754fa38b6e2" status: 404 len: 109 microversion: 2.1 time: 0.036724 Sep 22 15:03:42.589923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 385/781] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 15:03:42 2022] GET /compute/v2.1/os-volumes/51087c14-25aa-4858-90ee-3754fa38b6e2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:03:42.778947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:42.780579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:42.789051 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:42.789540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:42.790175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:42.791003 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:42.791489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:42.791913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:42.941677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:42.949324 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-606ccf9a-bb7d-4773-87c2-ee5973cbd0f5 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.174245 Sep 22 15:03:42.949842 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 397/782] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:42 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:43.565503 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:43.566554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:43.571923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:43.572482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:43.580938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:43.581433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:43.581870 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:43.582624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:43.583121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:43.583611 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:43.718446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:43.726777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:43.728314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:43.729498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-84c1532a-d827-4331-a250-323da661c896 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.165372 Sep 22 15:03:43.730052 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 386/783] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:43 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:43.972667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:43.973284 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:43.975265 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=6 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:43.981292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:43.982295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:43.982754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:43.983462 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:43.983920 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:43.984351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:44.166025 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:44.174659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a95bb676-1c85-4380-9f2b-4d566d78c4ea tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.206079 Sep 22 15:03:44.175257 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 398/784] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:43 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:44.574289 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-79ee227f-308a-454a-9818-ac88f77d8485 req-981f54fd-2326-40f9-8c2c-bf3100974878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3591de7f-0312-4d50-8be9-b965fb09e050", "name": "network-vif-plugged", "status": "completed", "tag": "ee13107d-dc99-4ace-8561-204bb89c889f"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:44.587106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-79ee227f-308a-454a-9818-ac88f77d8485 req-981f54fd-2326-40f9-8c2c-bf3100974878 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:44.588229 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-79ee227f-308a-454a-9818-ac88f77d8485 req-981f54fd-2326-40f9-8c2c-bf3100974878 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:44.588699 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-79ee227f-308a-454a-9818-ac88f77d8485 req-981f54fd-2326-40f9-8c2c-bf3100974878 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:44.601928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-79ee227f-308a-454a-9818-ac88f77d8485 req-981f54fd-2326-40f9-8c2c-bf3100974878 service nova] Creating event network-vif-plugged:ee13107d-dc99-4ace-8561-204bb89c889f for instance 3591de7f-0312-4d50-8be9-b965fb09e050 on hv-cinder-84456 Sep 22 15:03:44.608601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-79ee227f-308a-454a-9818-ac88f77d8485 req-981f54fd-2326-40f9-8c2c-bf3100974878 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037472 Sep 22 15:03:44.610018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 387/785] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:44.755662 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:44.756599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:44.763977 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:44.764751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:44.765177 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:44.766036 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:44.766650 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:44.767097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:44.931641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:44.941460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:44.942924 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:44.944092 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-95948791-ce89-4258-b60c-1053e666fb19 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.192259 Sep 22 15:03:44.944640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 399/786] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:44 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:45.199374 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:45.199952 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:45.206698 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:45.207217 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:45.207705 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:45.208381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:45.208833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:45.209511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:45.346673 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:45.355771 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-39194f64-01e6-4c20-b71c-933d2b86f245 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1367 microversion: 2.1 time: 0.160697 Sep 22 15:03:45.357372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 388/787] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:45 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:45.970208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:45.971427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:45.978344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:45.979017 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:45.979705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:45.980586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:45.981352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:45.982521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:46.123629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:46.131633 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:46.133069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:46.134452 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b9dfbad7-7bc9-4b44-a505-8d0c811be54f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.168952 Sep 22 15:03:46.134981 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 400/788] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:45 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:03:46.381285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:46.381895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:46.390316 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:46.390907 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:46.391515 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:46.392408 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:46.392861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:46.393622 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:46.559703 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:46.567642 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-39f85292-f6ed-4ac2-a9b7-9780c7a36ffb tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1557 microversion: 2.1 time: 0.190211 Sep 22 15:03:46.568208 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 389/789] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:46 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:46.589797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:46.590291 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:46.597030 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:46.597516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:46.597951 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:46.598651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:46.599161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:46.599589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:46.678636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-733ecdad-d28d-4970-9b8b-20a69e252412 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092866 Sep 22 15:03:46.679322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 401/790] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 15:03:46 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:47.161073 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:47.161678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:47.167601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:47.168085 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:47.168518 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:47.169236 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:47.169687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:47.170126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:47.298932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:47.307086 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:47.308549 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:47.310254 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0d396fea-749a-42a0-a424-f7ba1069677d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.153142 Sep 22 15:03:47.311017 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 390/791] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:47 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:47.760432 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-b2b24d45-8d22-46bc-92bc-228084af761c req-aa414f2b-44e9-46b7-a2e3-f85b0d1c513f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3591de7f-0312-4d50-8be9-b965fb09e050", "tag": "ee13107d-dc99-4ace-8561-204bb89c889f"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:03:47.771317 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-b2b24d45-8d22-46bc-92bc-228084af761c req-aa414f2b-44e9-46b7-a2e3-f85b0d1c513f service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:47.772046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-b2b24d45-8d22-46bc-92bc-228084af761c req-aa414f2b-44e9-46b7-a2e3-f85b0d1c513f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:47.772708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-b2b24d45-8d22-46bc-92bc-228084af761c req-aa414f2b-44e9-46b7-a2e3-f85b0d1c513f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:47.786976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-b2b24d45-8d22-46bc-92bc-228084af761c req-aa414f2b-44e9-46b7-a2e3-f85b0d1c513f service nova] Creating event network-changed:ee13107d-dc99-4ace-8561-204bb89c889f for instance 3591de7f-0312-4d50-8be9-b965fb09e050 on hv-cinder-84456 Sep 22 15:03:47.796264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-b2b24d45-8d22-46bc-92bc-228084af761c req-aa414f2b-44e9-46b7-a2e3-f85b0d1c513f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187437 Sep 22 15:03:47.796892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 402/792] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:03:48.337517 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:48.338235 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:48.355917 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:48.357024 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:48.357690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:48.358617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:48.359352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:48.359937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:48.498279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:48.507456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:48.509028 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:48.510305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dcbc64dd-b655-45cf-a196-8a9506205131 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.178093 Sep 22 15:03:48.510982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 391/793] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:48 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:49.539059 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:49.539768 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:49.545851 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:49.546334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:49.546780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:49.547474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:49.547925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:49.548350 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:49.685765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:49.694351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:49.695841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:49.697016 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5e1762c7-400d-44ca-8b5f-e037bf161db3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.162829 Sep 22 15:03:49.697571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 403/794] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:49 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:50.723182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:50.723797 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:50.730204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:50.730686 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:50.731180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:50.731870 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:50.732325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:50.732749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:50.858789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:50.866901 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:50.868333 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:50.869474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f6f6cc39-8904-4a90-b03f-759955fb65b6 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.150255 Sep 22 15:03:50.870030 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 392/795] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:50 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:51.895508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:51.896119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:51.902278 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:51.903310 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:51.903769 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:51.904450 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:51.904896 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:51.905315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:52.040894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:52.049991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:52.051509 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:52.052707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-db5a4e87-aeb3-4d82-a7f9-0a6626454fb9 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.161102 Sep 22 15:03:52.053679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 404/796] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:51 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:53.079368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:53.080027 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:53.087004 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:53.087481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:53.087914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:53.088632 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:53.089110 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:53.089524 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:53.225102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:53.233898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:53.235402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:53.236674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-70114642-05b6-45e1-a9e9-33a9a29700e7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.161285 Sep 22 15:03:53.237184 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 393/797] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:53 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:54.270138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:54.270897 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:54.278707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:54.279478 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:54.280000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:54.281029 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:54.281614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:54.282149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:54.431061 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:54.439820 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:54.441273 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:54.442420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bbe30278-a607-482c-91c2-3cd2c9373c24 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.183926 Sep 22 15:03:54.443015 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 405/798] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:54 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:55.467410 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:55.468009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:55.474759 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:55.475346 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:55.475799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:55.476494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:55.476948 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:55.477425 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:55.620768 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:55.629570 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:55.631096 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:55.632256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-701e7897-6364-4b1d-aa04-03fe9c7f1ee3 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.168788 Sep 22 15:03:55.632848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 394/799] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:55 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:56.658885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:56.659497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:56.663220 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:56.667148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:56.667631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:56.668065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:56.668751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:56.669174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:56.669795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:56.812776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:56.821885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:56.823380 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:56.824540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-836edcd1-2b9c-4a11-9771-6ab6d77eb063 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.170552 Sep 22 15:03:56.825289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 406/800] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:56 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:57.851354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:57.851970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:57.858707 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:57.859226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:57.859667 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:57.860377 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:57.860879 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:57.861308 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:57.989105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:57.997808 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:57.999276 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:58.000419 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-525bae3c-82d5-4891-a07b-b4ef73edc649 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.153006 Sep 22 15:03:58.000966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 395/801] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:57 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:58.147702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:58.149993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:58.156384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:58.156871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:58.157393 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:58.158004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:58.158453 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:58.158918 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:58.190202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1bf0149d-a18e-450f-b592-fddc2f2b341c tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046351 Sep 22 15:03:58.190802 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 407/802] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:03:58 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 15:03:58.256340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:58.256863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:58.262882 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:58.263404 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:58.263840 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:58.264530 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:58.264998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:58.265422 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:58.292070 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:03:58.329166 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:03:58.375136 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9bbd078c-5fd4-49ba-9291-b3e28b1097da tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 204 len: 0 microversion: 2.1 time: 0.122384 Sep 22 15:03:58.375988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 396/803] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:03:58 2022] DELETE /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:03:58.389762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:58.390320 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:58.396567 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:58.397084 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:58.397546 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:58.398247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:58.398705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:58.399163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:58.540130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:58.548580 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2687c49f-57ca-45fc-a0f8-3d7e793d5ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1675 microversion: 2.1 time: 0.163649 Sep 22 15:03:58.549153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 408/804] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:58 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:03:59.027071 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:59.027761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:59.034206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:59.034680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:59.035136 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:59.035813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:59.036257 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:59.036687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:59.170313 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:59.178367 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:59.179844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:59.181003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6ce2451f-3663-4a49-bbe4-385fc7d39eeb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.158221 Sep 22 15:03:59.181560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 397/805] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:03:59 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:03:59.573402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:03:59.574022 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:03:59.581168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:59.581646 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:59.582081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:59.582795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:03:59.583254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:03:59.583679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:03:59.715820 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:03:59.724366 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-460f20a5-244d-400a-90ba-0754147302b5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1675 microversion: 2.1 time: 0.154784 Sep 22 15:03:59.725104 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 409/806] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:03:59 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:00.205362 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:00.205978 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:00.212652 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:00.213137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:00.213566 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:00.214260 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:00.214713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:00.215159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:00.373326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:00.381499 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:00.382988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:00.384187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d8bfb8a3-18e3-44f0-97c3-5e3a6f3bb148 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.182676 Sep 22 15:04:00.384752 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 398/807] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:00 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:00.748283 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:00.750419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:00.757129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:00.757617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:00.758054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:00.758785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:00.759592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:00.760024 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:00.782338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:00.929740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:00.940734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-832dd058-03be-4140-ac5d-3847eb6b384f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1675 microversion: 2.1 time: 0.196843 Sep 22 15:04:00.950969 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 410/808] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:00 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:01.411083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:01.411700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:01.418414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:01.418975 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:01.419423 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:01.420125 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:01.420760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:01.421192 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:01.506212 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-4ba2c670-36b5-4dcf-a67b-7adb3f3a0fe5 req-4dbd0bed-fae4-480c-af7c-f716d38b8622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea87b94-a17c-4cc6-b9f0-2113981000f9", "name": "network-vif-deleted", "tag": "b27f208f-6d3b-421a-8a4d-858c6688a093"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:01.529840 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4ba2c670-36b5-4dcf-a67b-7adb3f3a0fe5 req-4dbd0bed-fae4-480c-af7c-f716d38b8622 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:01.531146 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4ba2c670-36b5-4dcf-a67b-7adb3f3a0fe5 req-4dbd0bed-fae4-480c-af7c-f716d38b8622 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:01.532216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4ba2c670-36b5-4dcf-a67b-7adb3f3a0fe5 req-4dbd0bed-fae4-480c-af7c-f716d38b8622 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:01.554953 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-4ba2c670-36b5-4dcf-a67b-7adb3f3a0fe5 req-4dbd0bed-fae4-480c-af7c-f716d38b8622 service nova] Creating event network-vif-deleted:b27f208f-6d3b-421a-8a4d-858c6688a093 for instance dea87b94-a17c-4cc6-b9f0-2113981000f9 on hv-cinder-84456 Sep 22 15:04:01.564078 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-4ba2c670-36b5-4dcf-a67b-7adb3f3a0fe5 req-4dbd0bed-fae4-480c-af7c-f716d38b8622 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061924 Sep 22 15:04:01.564698 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 411/809] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:01.671967 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:01.680976 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:01.682431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:01.686072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-79ae09b5-0747-4e1a-8f33-e6776f9ecce8 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1744 microversion: 2.20 time: 0.276492 Sep 22 15:04:01.687868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 399/810] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:01 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1744 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:01.969379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:01.970097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:01.983754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:01.984253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:01.984696 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:01.985480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:01.985945 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:01.986371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:02.023890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:02.024399 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:02.024823 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:02.025280 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lazy-loading 'fault' on Instance uuid dea87b94-a17c-4cc6-b9f0-2113981000f9 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:04:02.073654 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:02.086573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0fe4ac17-88bb-41af-8923-abd6f742f170 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 200 len: 1328 microversion: 2.1 time: 0.123209 Sep 22 15:04:02.087605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 412/811] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:01 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:02.720609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:02.721886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:02.730604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:02.731133 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:02.732211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:02.733079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:02.733380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:02.733807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:02.901248 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:02.914390 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:02.916921 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:02.918087 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d9327e58-6080-4fc9-9e7b-ec3e02b0d871 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1744 microversion: 2.20 time: 0.204351 Sep 22 15:04:02.918814 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 400/812] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:02 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:03.112324 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:03.113206 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:03.121150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:03.121740 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:03.122302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:03.123125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:03.123673 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:03.124388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:03.138637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] HTTP exception thrown: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Request method failure captured: Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 HTTP/1.1 Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHhidFOXVJGdBOQPKIspkDCtoKuDy38Qm8cwYLL-DbROvv3HD8XCd-FPZHrW7qz-OtSQEb7VG-m8TGwoim9sahoPN7s1BQ373H9kzdSxUUXbhDBAsx8fpkFFh1YuQWWB7ZHeBq5WPoWwA_a2kmAwYYWIJbF_R8XyoOpsIZvl136JPnw Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:04:03.140617 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: da004a191bcd43b6a0865919813ec1a8 Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:04:03.142153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'dea87b94-a17c-4cc6-b9f0-2113981000f9'} Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:03.143011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:04:03.144330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:03.145500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Returning 404 to user: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:03.145500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bbb48768-f270-4fa0-91c2-94c79f4c990e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 404 len: 111 microversion: 2.1 time: 0.034717 Sep 22 15:04:03.145500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 413/813] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:03 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:03.153037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bb831b57-3042-40b9-a0a7-73b483923b0a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '.version_select at 0x7f77e6185d30>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:03.173563 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bb831b57-3042-40b9-a0a7-73b483923b0a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555127664" status: 202 len: 0 microversion: 2.1 time: 0.024941 Sep 22 15:04:03.174395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 401/814] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 22 15:04:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555127664 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:04:03.944600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:03.945505 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:03.952090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:03.952583 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:03.953020 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:03.953729 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:03.954180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:03.954800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:04.116623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3cd4256e-1999-4635-b9dc-f6fa9eaabe0a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'create', calling method: .version_select at 0x7f77e6150040>, body: {"keypair": {"name": "tempest-keypair-601601552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7s7ConR5MOOXEJLpcAmTcQUjERX+fIz5G+OBYeqaR8Ug26G1K2EMPJKLolhiXw7v0awbkCGZelAr3+2Ax/z3Jg8bi2BTYmj86/3XBQhZPTq4oHa3tuohJSYIxGil6emw=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:04.167539 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:04.179615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:04.180329 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-3cd4256e-1999-4635-b9dc-f6fa9eaabe0a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:04:04.181736 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:04.183162 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-82b2da7d-ab90-4c07-94e1-bc2940eba2cb tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.242466 Sep 22 15:04:04.184216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 414/815] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:03 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:04.188088 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-3cd4256e-1999-4635-b9dc-f6fa9eaabe0a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for user da004a191bcd43b6a0865919813ec1a8 and project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:04:04.223466 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3cd4256e-1999-4635-b9dc-f6fa9eaabe0a tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112350 Sep 22 15:04:04.224844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 402/816] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:04:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:05.093815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-c324784e-a084-48f1-9f54-a0c31789edec req-fe786bc7-f5ea-46e9-b235-d90ca045f200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eaa6dc-ecc8-44ac-a552-9753ed98baa4", "name": "network-vif-plugged", "status": "completed", "tag": "2a4fb816-a034-43e4-973a-90bfa5151681"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:05.110142 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c324784e-a084-48f1-9f54-a0c31789edec req-fe786bc7-f5ea-46e9-b235-d90ca045f200 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:05.111496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c324784e-a084-48f1-9f54-a0c31789edec req-fe786bc7-f5ea-46e9-b235-d90ca045f200 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:05.112099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-c324784e-a084-48f1-9f54-a0c31789edec req-fe786bc7-f5ea-46e9-b235-d90ca045f200 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:05.134547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-c324784e-a084-48f1-9f54-a0c31789edec req-fe786bc7-f5ea-46e9-b235-d90ca045f200 service nova] Creating event network-vif-plugged:2a4fb816-a034-43e4-973a-90bfa5151681 for instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 on hv-cinder-84456 Sep 22 15:04:05.139606 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-c324784e-a084-48f1-9f54-a0c31789edec req-fe786bc7-f5ea-46e9-b235-d90ca045f200 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.424042 Sep 22 15:04:05.140786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 415/817] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:05.213751 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:05.214311 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:05.232573 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:05.233973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:05.237980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:05.238960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:05.239670 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:05.240483 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:05.495813 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:05.507118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:05.507118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:05.519681 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-168193dc-cb3b-474b-88ad-98122790008d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.311328 Sep 22 15:04:05.520286 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 403/818] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:05 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:06.199113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2104107441", "imageRef": "f54d506f-909e-4215-9535-1a8050a81b92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "029997dd-1780-49cc-a9d7-c81e1fc0dca4"}], "security_groups": [{"name": "tempest-securitygroup--704454101"}], "key_name": "tempest-keypair-601601552", "user_data": "}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:06.311399 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] validate_networks() for [('029997dd-1780-49cc-a9d7-c81e1fc0dca4', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:04:06.552914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:06.560396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:06.568190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:06.568764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:06.569274 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:06.570068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:06.570587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:06.571121 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:07.034864 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:07.050171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:07.052026 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:07.053505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3f525c2a-658d-49f2-bcf7-c587b507b99f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.507807 Sep 22 15:04:07.054616 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 404/819] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:06 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:07.255101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:04:07.255589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:04:07.256169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:04:07.257293 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:04:07.257932 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:04:07.282577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:07.283544 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:07.284537 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:07.286225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:07.287091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:07.287775 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:07.315365 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:04:07.320743 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Getting quotas for user da004a191bcd43b6a0865919813ec1a8 and project 1c7d5abbf8274516bf79312e3fa22f6c. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:04:07.343642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:04:07.346162 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d506f-909e-4215-9535-1a8050a81b92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:04:07.409144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c12aaa1e-7fb7-4a9a-8a3d-9f2bf7b570a1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.215384 Sep 22 15:04:07.411781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 416/820] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:04:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:04:07.425001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bfe460d7-2309-4a73-a7bd-edca2348c55b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:07.425779 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bfe460d7-2309-4a73-a7bd-edca2348c55b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:07.535657 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bfe460d7-2309-4a73-a7bd-edca2348c55b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:07.546184 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bfe460d7-2309-4a73-a7bd-edca2348c55b tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1237 microversion: 2.1 time: 0.127126 Sep 22 15:04:07.567098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 405/821] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:07 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:08.081095 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:08.081709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:08.092437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:08.093410 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:08.093851 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:08.094565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:08.095039 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:08.095463 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:08.266194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:08.279729 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:08.281211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:08.282829 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d43e1f2c-957a-4953-955a-7dd6e191bd8d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.205584 Sep 22 15:04:08.283667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 417/822] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:08 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:08.576640 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:08.579108 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:08.589373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:08.590940 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:08.591871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:08.593366 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:08.593827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:08.594577 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:08.690791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:08.701047 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1e5883bc-d95e-43bb-9fa4-67f4945d997e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1289 microversion: 2.1 time: 0.131957 Sep 22 15:04:08.702016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 406/823] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:08 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:09.309922 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:09.310538 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:09.331132 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:09.331897 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:09.332506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:09.333288 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:09.333907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:09.334333 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:09.493647 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:09.503337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:09.506600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:09.508184 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4122bf6d-edd4-4c32-a549-01419d42985b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.202242 Sep 22 15:04:09.516373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 418/824] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:09 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:09.727459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:09.729277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:09.736197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:09.737018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:09.737669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:09.739080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:09.739789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:09.740430 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:09.811978 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:09.823219 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-53c16617-6088-4405-b907-2a17e1795b9d tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1295 microversion: 2.1 time: 0.101134 Sep 22 15:04:09.824074 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 407/825] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:09 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:10.535280 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:10.537196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:10.544327 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:10.545073 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:10.545739 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:10.546688 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:10.547391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:10.548069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:10.707457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:10.720540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:10.722043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:10.723522 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0ef88278-4369-4844-bd1b-417fa6d46547 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.192719 Sep 22 15:04:10.724678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 419/826] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:10 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:10.849125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:10.850131 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:10.856956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-23e92ee2-aa01-46e5-90e3-e191bcd340ca req-05f1319f-855a-45b5-8d3e-8969bb388e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04af519-b484-47b3-a43c-e755c25e50ab", "tag": "1f7c7d3b-9213-4cca-bf91-d234d168fcf1"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:10.861190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:10.862062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:10.863000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:10.864542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:10.865379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:10.867488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:10.874079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:10.889299 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-23e92ee2-aa01-46e5-90e3-e191bcd340ca req-05f1319f-855a-45b5-8d3e-8969bb388e53 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:10.889798 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-23e92ee2-aa01-46e5-90e3-e191bcd340ca req-05f1319f-855a-45b5-8d3e-8969bb388e53 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:10.890240 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-23e92ee2-aa01-46e5-90e3-e191bcd340ca req-05f1319f-855a-45b5-8d3e-8969bb388e53 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:10.915836 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-23e92ee2-aa01-46e5-90e3-e191bcd340ca req-05f1319f-855a-45b5-8d3e-8969bb388e53 service nova] Creating event network-changed:1f7c7d3b-9213-4cca-bf91-d234d168fcf1 for instance e04af519-b484-47b3-a43c-e755c25e50ab on hv-cinder-84456 Sep 22 15:04:10.922152 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-23e92ee2-aa01-46e5-90e3-e191bcd340ca req-05f1319f-855a-45b5-8d3e-8969bb388e53 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078944 Sep 22 15:04:10.923618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 408/827] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:11.045086 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:11.055334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e5387708-d8d7-4041-aa41-48d1f6a57001 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.211030 Sep 22 15:04:11.063302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 420/828] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:10 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:11.753886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:11.754608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:11.762380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:11.762972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:11.763543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:11.764328 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:11.764848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:11.765307 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:11.912554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:11.922118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:11.923628 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:11.925740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-98978b4d-cca8-4714-ac63-8f9ab0f6877a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.180017 Sep 22 15:04:11.926303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 409/829] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:11 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:12.080965 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:12.082305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:12.089869 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:12.091383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:12.092041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:12.092859 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:12.093415 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:12.093944 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:12.277967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:12.286772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-89d30b26-e901-4bdd-8a08-2409c14eafc5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.209763 Sep 22 15:04:12.288516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 421/830] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:12 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:12.956956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:12.957757 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:12.965226 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:12.966599 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:12.967336 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:12.968269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:12.968923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:12.969553 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:13.188330 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:13.207040 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:13.210006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:13.212793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-69362ec5-acab-4b2e-bf63-3c7455c6a987 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.260477 Sep 22 15:04:13.213977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 410/831] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:12 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:04:13.310028 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:13.311295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:13.317989 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:13.318688 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:13.319232 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:13.320757 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:13.321384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:13.323697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:13.490538 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:13.498978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-defa391d-ae0d-47e6-9851-2e12fccd95e9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.192715 Sep 22 15:04:13.515683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 422/832] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:13 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:14.240391 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:14.241003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:14.247595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:14.248104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:14.248539 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:14.249232 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:14.249682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:14.250108 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:14.381543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:14.389718 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:14.391197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:14.392348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5c06f488-ea7c-4914-b152-958c3742be12 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.155926 Sep 22 15:04:14.392908 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 411/833] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:14 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:14.524563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:14.525187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:14.533179 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:14.533652 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:14.534076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:14.534811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:14.535259 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:14.535674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:14.667867 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:14.675578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-01c1d521-320f-48ee-b677-dae7496b1926 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.154851 Sep 22 15:04:14.676228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 423/834] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:14 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:15.417992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:15.418622 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:15.425690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:15.426236 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:15.426674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:15.427397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:15.427855 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:15.428284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:15.562833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:15.571246 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:15.572668 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:15.573814 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-28cff550-e322-4614-b82b-0524de47689a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.159866 Sep 22 15:04:15.574868 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 412/835] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:15 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:15.698441 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:15.699075 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:15.705620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:15.706093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:15.706521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:15.707238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:15.707683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:15.708103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:15.838089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:15.845813 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c562823b-0b5a-40d4-ad0c-94227ffdae1f tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.151149 Sep 22 15:04:15.846385 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 424/836] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:15 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:16.599603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:16.600193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:16.607338 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:16.607909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:16.608336 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:16.609041 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:16.609524 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:16.610014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:16.760285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:16.768618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:16.769920 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:16.771132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0076c982-7eb0-4b1d-8138-b7f17031999d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1739 microversion: 2.20 time: 0.175750 Sep 22 15:04:16.771697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 413/837] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:16 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:16.868176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:16.869222 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:16.876608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:16.877218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:16.877751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:16.878787 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:16.879909 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:16.880763 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:17.018440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:17.026169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3fd0314c-ecc8-4400-b784-1abc33a5b0ab tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.161699 Sep 22 15:04:17.026692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 425/838] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:16 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:17.800487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:17.801616 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:17.804684 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:17.811418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:17.811909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:17.812348 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:17.813049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:17.813511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:17.813937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:17.987145 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:18.001498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:18.002991 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:18.004151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-31d0f4dc-5006-4c12-912a-160a96d056fa tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1721 microversion: 2.20 time: 0.210838 Sep 22 15:04:18.004711 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 414/839] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:17 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:04:18.049994 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:18.050613 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:18.052649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:18.053393 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=6 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:18.060458 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:18.060947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:18.061379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:18.062070 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:18.062518 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:18.063002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:18.192280 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:18.200983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e91383f1-a8e6-4dec-b339-06de8bc23a50 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.155205 Sep 22 15:04:18.201465 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 426/840] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:18 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:18.708117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-943606a8-bf77-43a3-8f37-357d14ef95f3 req-a3598ebc-2ca8-435b-b692-088e676e7252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04af519-b484-47b3-a43c-e755c25e50ab", "name": "network-vif-plugged", "status": "completed", "tag": "1f7c7d3b-9213-4cca-bf91-d234d168fcf1"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:18.718317 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-943606a8-bf77-43a3-8f37-357d14ef95f3 req-a3598ebc-2ca8-435b-b692-088e676e7252 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:18.718838 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-943606a8-bf77-43a3-8f37-357d14ef95f3 req-a3598ebc-2ca8-435b-b692-088e676e7252 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:18.719270 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-943606a8-bf77-43a3-8f37-357d14ef95f3 req-a3598ebc-2ca8-435b-b692-088e676e7252 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:18.730437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-943606a8-bf77-43a3-8f37-357d14ef95f3 req-a3598ebc-2ca8-435b-b692-088e676e7252 service nova] Creating event network-vif-plugged:1f7c7d3b-9213-4cca-bf91-d234d168fcf1 for instance e04af519-b484-47b3-a43c-e755c25e50ab on hv-cinder-84456 Sep 22 15:04:18.735693 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-943606a8-bf77-43a3-8f37-357d14ef95f3 req-a3598ebc-2ca8-435b-b692-088e676e7252 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031309 Sep 22 15:04:18.736295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 415/841] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:19.033366 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:19.033984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:19.040174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:19.040667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:19.041104 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:19.041806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:19.042322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:19.042682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:19.196438 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:19.204797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:19.206257 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:19.207669 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-27f3f4ec-1dd3-48fb-9ad6-d9ee5cfc20ea tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1721 microversion: 2.20 time: 0.178099 Sep 22 15:04:19.208221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 427/842] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:19 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:19.225690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:19.226537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:19.234453 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:19.235018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:19.235450 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:19.236345 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:19.236961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:19.237383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:19.384982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:19.392719 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-df0496e0-022a-4cff-84f3-ff2d53ff7742 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.172604 Sep 22 15:04:19.393295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 416/843] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:19 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:20.236924 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:20.236924 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:20.242934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.243351 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.243789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.244586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.245026 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.245455 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.378368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:20.386905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:20.388387 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:20.390187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-aab6192f-dfbe-48bf-9499-3ba48e02c058 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1664 microversion: 2.20 time: 0.158616 Sep 22 15:04:20.390807 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 428/844] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:20 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:20.415903 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:20.416112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f201656d-935c-4024-aa50-d5317dbc779e"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:20.417361 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:20.418478 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:20.423641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.424117 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.424569 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.425055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.425498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.425624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.425947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.426083 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.426653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.426818 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.427228 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.427662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.432080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:20.442855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=100 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:20.564831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:20.573058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-df38efe1-2206-4b04-8cfb-0681b3fe2cf2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1362 microversion: 2.1 time: 0.161037 Sep 22 15:04:20.573817 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 429/845] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:20 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:20.710951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-12683afc-8588-446e-b3e6-06b18f443125 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299164 Sep 22 15:04:20.711708 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 417/846] 10.222.0.26 () {62 vars in 1364 bytes} [Thu Sep 22 15:04:20 2022] POST /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 15:04:20.755408 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-070dce6f-b660-47db-a457-3a402c2d40ea req-6c7786ae-2127-43d0-9198-c595eaa1668c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eaa6dc-ecc8-44ac-a552-9753ed98baa4", "name": "network-vif-unplugged", "status": "completed", "tag": "2a4fb816-a034-43e4-973a-90bfa5151681"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:20.765117 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-070dce6f-b660-47db-a457-3a402c2d40ea req-6c7786ae-2127-43d0-9198-c595eaa1668c service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.765674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-070dce6f-b660-47db-a457-3a402c2d40ea req-6c7786ae-2127-43d0-9198-c595eaa1668c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.766302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-070dce6f-b660-47db-a457-3a402c2d40ea req-6c7786ae-2127-43d0-9198-c595eaa1668c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.777397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.compute.server_external_events [req-070dce6f-b660-47db-a457-3a402c2d40ea req-6c7786ae-2127-43d0-9198-c595eaa1668c service nova] Unable to find a host for instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4. Dropping event network-vif-unplugged {{(pid=120694) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 22 15:04:20.778265 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-070dce6f-b660-47db-a457-3a402c2d40ea req-6c7786ae-2127-43d0-9198-c595eaa1668c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026999 Sep 22 15:04:20.778991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 430/847] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 22 15:04:20.840542 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:20.841096 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:20.847910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.848394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.848823 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:20.849531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:20.849977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:20.850395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.083306 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-878f7b72-2cb4-460e-bcf4-23eb0b1469df tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-volume_attachments/f201656d-935c-4024-aa50-d5317dbc779e" status: 202 len: 0 microversion: 2.20 time: 0.246685 Sep 22 15:04:21.083909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 418/848] 10.222.0.26 () {60 vars in 1457 bytes} [Thu Sep 22 15:04:20 2022] DELETE /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-volume_attachments/f201656d-935c-4024-aa50-d5317dbc779e => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:04:21.144398 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:21.144984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:21.150943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.151424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.151865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.152552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.153005 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.153429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.184623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120694) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 15:04:21.252009 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d7767f9b-c848-4728-97fc-80053ef2023f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "POST /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/action" status: 202 len: 0 microversion: 2.20 time: 0.111475 Sep 22 15:04:21.252692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 431/849] 10.222.0.26 () {62 vars in 1319 bytes} [Thu Sep 22 15:04:21 2022] POST /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:04:21.263473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:21.263473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:21.270094 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.270557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.271035 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.271734 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.272371 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.273046 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.448463 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:21.458231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:21.459731 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:21.462988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-942c32f4-f395-4ad8-9f18-f934ff1b4bef tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1672 microversion: 2.20 time: 0.203397 Sep 22 15:04:21.462988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 419/850] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:21 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:21.596417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:21.597042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:21.603332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.603826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.604261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.604967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.605425 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.605991 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.773772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:21.783966 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6882fc82-c3a9-4571-92a7-d0c59e669f00 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1549 microversion: 2.1 time: 0.191835 Sep 22 15:04:21.784818 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 432/851] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:21 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:21.833312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:21.834295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:21.848448 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.849114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.849699 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.850608 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:21.851244 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:21.851811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:21.939689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-aa572822-c216-4e5d-b41b-d4c4a4c6821e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119260 Sep 22 15:04:21.940224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 420/852] 10.222.0.26 () {58 vars in 1275 bytes} [Thu Sep 22 15:04:21 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:22.488140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:22.488958 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:22.495629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:22.496121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:22.496557 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:22.497262 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:22.497712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:22.498140 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:22.750565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:22.759021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:22.760709 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:22.762100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1c44b52b-335c-44d1-90b9-8330b6aa3135 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.277824 Sep 22 15:04:22.763415 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 433/853] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:22 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:23.174059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-0d041ac8-167b-4684-abc9-9b6326bc2dd1 req-6da01114-ac99-4d29-8bc0-ad66663c637c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04af519-b484-47b3-a43c-e755c25e50ab", "tag": "1f7c7d3b-9213-4cca-bf91-d234d168fcf1"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:23.183765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0d041ac8-167b-4684-abc9-9b6326bc2dd1 req-6da01114-ac99-4d29-8bc0-ad66663c637c service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:23.184248 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0d041ac8-167b-4684-abc9-9b6326bc2dd1 req-6da01114-ac99-4d29-8bc0-ad66663c637c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:23.184679 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0d041ac8-167b-4684-abc9-9b6326bc2dd1 req-6da01114-ac99-4d29-8bc0-ad66663c637c service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:23.197420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-0d041ac8-167b-4684-abc9-9b6326bc2dd1 req-6da01114-ac99-4d29-8bc0-ad66663c637c service nova] Creating event network-changed:1f7c7d3b-9213-4cca-bf91-d234d168fcf1 for instance e04af519-b484-47b3-a43c-e755c25e50ab on hv-cinder-84456 Sep 22 15:04:23.202905 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-0d041ac8-167b-4684-abc9-9b6326bc2dd1 req-6da01114-ac99-4d29-8bc0-ad66663c637c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174666 Sep 22 15:04:23.203497 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 421/854] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:23.793290 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:23.793862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:23.809749 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:23.811193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:23.811827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:23.813489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:23.814129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:23.814766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:24.090109 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:24.105202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:24.106925 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:24.108827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d7a7b0ee-bed3-4de3-af96-6548a52cb6b5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.320426 Sep 22 15:04:24.109438 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 434/855] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:23 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:25.136364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:25.137062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:25.145513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:25.146494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:25.147209 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:25.148544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:25.149249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:25.149907 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:25.303167 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:25.317930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:25.319413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:25.320625 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c56c9c1e-3b0c-4577-915e-cae3268a1e57 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.188686 Sep 22 15:04:25.321187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 422/856] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:25 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:26.348407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:26.348926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:26.363589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:26.364089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:26.364567 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:26.365286 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:26.365744 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:26.366173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:26.512352 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:26.524594 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:26.526513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:26.527954 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-44ecd527-276c-4459-846c-67ba04f90c81 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.183679 Sep 22 15:04:26.537847 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 435/857] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:26 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:27.559811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:27.560493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:27.567265 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:27.567759 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:27.568195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:27.568932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:27.569388 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:27.569873 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:27.707350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:27.716492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:27.718100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:27.719441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bd54982a-5b7b-460e-9c60-8e8793858828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.163628 Sep 22 15:04:27.720102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 423/858] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:27 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:28.746127 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:28.746882 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:28.752859 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:28.755045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:28.755834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:28.756349 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:28.757075 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:28.757531 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:28.757959 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:28.919793 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:28.929575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:28.931203 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:28.932619 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1adb42d9-44d1-46af-89f9-150761b37861 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.190418 Sep 22 15:04:28.933586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 436/859] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:28 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:29.970112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:29.970807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:29.977886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:29.978375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:29.978851 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:29.979540 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:29.979986 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:29.980406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:30.132829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:30.142157 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:30.143713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:30.144795 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bc47ada5-6ecf-4755-baf4-fb12bd2a7492 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.180115 Sep 22 15:04:30.145569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 424/860] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:29 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:31.171145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:31.172335 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:31.178972 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:31.179685 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:31.180219 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:31.181101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:31.181596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:31.182094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:31.348585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:31.359638 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:31.361357 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:31.362715 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-58ad7e9c-f52f-46db-b6b2-09b0a5cc2f2d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.195524 Sep 22 15:04:31.363404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 437/861] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:31 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:31.365877 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:31.366494 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:31.374259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:31.374754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:31.375212 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:31.376112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:31.376741 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:31.377448 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:31.412785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b470b5bf-ebb0-4b84-8832-b0af130c0156 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/ips" status: 200 len: 150 microversion: 2.1 time: 0.050974 Sep 22 15:04:31.413764 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 425/862] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:04:31 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:32.398014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:32.398911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:32.405830 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:32.406243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:32.406678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:32.407466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:32.407823 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:32.408244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:32.545100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:32.553195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:32.554623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:32.555857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-524b13d9-fa5a-422a-ae5d-6454ae592212 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.161992 Sep 22 15:04:32.556402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 438/863] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:32 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:32.830332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a06a3e7c-e8b1-424e-9107-b7a3e6396513"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:32.832774 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:32.839753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:32.840242 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:32.840680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:32.842062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:32.842522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:32.842976 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:33.580716 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:33.581419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:33.588289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:33.588771 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:33.589221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:33.589915 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:33.590359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:33.590801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:33.717834 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:33.725857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:33.727344 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:33.728505 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-386926dc-4306-4e81-b470-63ee79cc2400 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.151583 Sep 22 15:04:33.729068 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 439/864] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:33 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:04:34.015714 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a73b571f-3713-4b50-b15b-b728cc2ab747 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "POST /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.189813 Sep 22 15:04:34.016295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 426/865] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:04:32 2022] POST /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments => generated 194 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:34.754984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:34.755545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:34.761969 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:34.762446 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:34.762915 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:34.763604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:34.764055 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:34.764478 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:34.894823 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:34.903226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:34.904683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:34.905848 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1cabd066-c034-4e58-8044-3a791bab30db tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.154891 Sep 22 15:04:34.906409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 440/866] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:34 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:35.932896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:35.933591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:35.940364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:35.940850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:35.941280 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:35.941961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:35.942438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:35.942895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:36.075068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:36.083697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:36.085391 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:36.086569 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fa91bdac-7cf7-4e4d-8fc9-3cb0af7ced33 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.158540 Sep 22 15:04:36.087132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 427/867] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:35 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:37.111357 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:37.112732 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:37.119397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:37.120121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:37.120554 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:37.121254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:37.121800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:37.122133 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:37.275731 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:37.291691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:37.293359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:37.294572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4a45001d-8f12-43e3-9790-ddc04328f09c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.187097 Sep 22 15:04:37.295675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 441/868] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:37 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:38.320137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:38.320746 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:38.329424 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:38.329424 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:38.329424 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:38.329424 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:38.329765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:38.329765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:38.470403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:38.472726 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=6,nova_cell1:UPDATE=10 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:38.479881 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:38.481326 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:38.483069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-009993d5-04fb-42e6-8a2e-32f866b7e9b7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.166752 Sep 22 15:04:38.483624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 428/869] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:38 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:38.821515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-aa7528ab-7853-47aa-b41c-9e66238c82c6 req-2cc017b4-2868-4c44-9975-c6ad3df3727f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eaa6dc-ecc8-44ac-a552-9753ed98baa4", "name": "network-vif-plugged", "status": "completed", "tag": "2a4fb816-a034-43e4-973a-90bfa5151681"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:38.831668 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-aa7528ab-7853-47aa-b41c-9e66238c82c6 req-2cc017b4-2868-4c44-9975-c6ad3df3727f service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:38.832148 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-aa7528ab-7853-47aa-b41c-9e66238c82c6 req-2cc017b4-2868-4c44-9975-c6ad3df3727f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:38.832675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-aa7528ab-7853-47aa-b41c-9e66238c82c6 req-2cc017b4-2868-4c44-9975-c6ad3df3727f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:38.845098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-aa7528ab-7853-47aa-b41c-9e66238c82c6 req-2cc017b4-2868-4c44-9975-c6ad3df3727f service nova] Creating event network-vif-plugged:2a4fb816-a034-43e4-973a-90bfa5151681 for instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 on hv-cinder-84456 Sep 22 15:04:38.850259 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-aa7528ab-7853-47aa-b41c-9e66238c82c6 req-2cc017b4-2868-4c44-9975-c6ad3df3727f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 Sep 22 15:04:38.850889 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 442/870] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:39.512339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:39.512956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:39.520911 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:39.521394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:39.521831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:39.522528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:39.523009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:39.523438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:39.669990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:39.678312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:39.679827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:39.681002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ccd4ce46-a9d5-4014-933d-513482e11666 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.172543 Sep 22 15:04:39.681557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 429/871] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:39 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:40.708033 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:40.708841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:40.722427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:40.728066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:40.732786 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:40.733756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:40.734511 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:40.736684 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:40.886031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:40.894790 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:40.896237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:40.897385 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8d30618a-4e72-411c-a013-61cda088d422 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1730 microversion: 2.20 time: 0.194031 Sep 22 15:04:40.897949 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 443/872] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:40 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:41.696387 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:41.696930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:41.703367 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:41.703844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:41.704276 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:41.704964 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:41.705413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:41.705843 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:41.785116 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lazy-loading 'services' on Instance uuid 3591de7f-0312-4d50-8be9-b965fb09e050 {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:04:41.856202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-836bcf18-ea06-4dc3-8d25-644fd157dad3 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments/a06a3e7c-e8b1-424e-9107-b7a3e6396513" status: 202 len: 0 microversion: 2.1 time: 0.163437 Sep 22 15:04:41.857366 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 430/873] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:04:41 2022] DELETE /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments/a06a3e7c-e8b1-424e-9107-b7a3e6396513 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:04:41.866523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:41.869145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:41.877160 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:41.877823 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:41.878413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:41.878995 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:41.879445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:41.879884 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:41.914878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1f6dde88-8e12-470f-99a8-f8d7b0aa148c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052502 Sep 22 15:04:41.915629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 444/874] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:04:41 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:41.924248 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:41.925021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:41.927082 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=46 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:41.932968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:41.933450 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:41.933873 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:41.934809 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:41.935266 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:41.935678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:42.071017 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:42.080720 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:42.082357 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:42.083578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d8e9672d-5fa1-4045-889a-6d3a23e2ab8f tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1717 microversion: 2.20 time: 0.164368 Sep 22 15:04:42.084123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 431/875] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:04:41 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:04:42.928141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:42.930303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:42.937498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:42.938002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:42.938509 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:42.939274 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:42.939808 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:42.940708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:42.971389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0f31a71a-f58d-4ae0-a264-47012beabacd tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047129 Sep 22 15:04:42.972175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 445/876] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:04:42 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 15:04:43.045074 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:43.046186 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:43.054614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:43.055249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:43.055831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:43.056674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:43.057277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:43.057765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:43.085980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:04:43.166925 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f2a51599-9d9b-4424-af92-baa3d629c325 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 204 len: 0 microversion: 2.1 time: 0.127138 Sep 22 15:04:43.167514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 432/877] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:04:43 2022] DELETE /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:04:43.176347 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:43.176965 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:43.183957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:43.185167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:43.185785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:43.186524 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:43.187014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:43.187443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:43.203579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:43.330237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:43.338487 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-821a2a34-2480-49f8-b987-259fe640cc03 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1682 microversion: 2.1 time: 0.165980 Sep 22 15:04:43.339102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 446/878] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:43 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:44.362354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:44.363122 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:44.369474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:44.369960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:44.370420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:44.371172 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:44.371627 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:44.372544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:44.507117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:44.515249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4ca98acb-876e-40d8-aa51-c859e4dae009 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1682 microversion: 2.1 time: 0.157223 Sep 22 15:04:44.515815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 433/879] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:44 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:45.537815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:45.538434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:45.545555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:45.546041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:45.546485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:45.547227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:45.547685 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:45.548111 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:45.618058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f298f0c6a9e44efba2a1e2fc648a0f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8a4487033d4e4aa231cc5873def0cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:04:45.626689 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4246f0e9-8262-48d1-b9b5-2dfdc3684b46 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 200 len: 1615 microversion: 2.1 time: 0.092732 Sep 22 15:04:45.627691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 447/880] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:45 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 1615 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:04:45.672968 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-dc9ee547-d411-4660-a6dd-117ac58634ff req-c149b36b-4b3a-4d4f-bc1a-81abf362a52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3591de7f-0312-4d50-8be9-b965fb09e050", "name": "network-vif-deleted", "tag": "ee13107d-dc99-4ace-8561-204bb89c889f"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:04:45.684713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dc9ee547-d411-4660-a6dd-117ac58634ff req-c149b36b-4b3a-4d4f-bc1a-81abf362a52f service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:45.685498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dc9ee547-d411-4660-a6dd-117ac58634ff req-c149b36b-4b3a-4d4f-bc1a-81abf362a52f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:45.685931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-dc9ee547-d411-4660-a6dd-117ac58634ff req-c149b36b-4b3a-4d4f-bc1a-81abf362a52f service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:45.698258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-dc9ee547-d411-4660-a6dd-117ac58634ff req-c149b36b-4b3a-4d4f-bc1a-81abf362a52f service nova] Creating event network-vif-deleted:ee13107d-dc99-4ace-8561-204bb89c889f for instance 3591de7f-0312-4d50-8be9-b965fb09e050 on hv-cinder-84456 Sep 22 15:04:45.703771 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-dc9ee547-d411-4660-a6dd-117ac58634ff req-c149b36b-4b3a-4d4f-bc1a-81abf362a52f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035114 Sep 22 15:04:45.704392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 434/881] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:04:46.651304 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:46.652070 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:46.659736 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:46.660299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:46.660871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:46.661604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:46.662066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:46.662502 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:46.679770 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 HTTP/1.1 Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:04:46.681449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:46.683164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '3591de7f-0312-4d50-8be9-b965fb09e050'} Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:46.684103 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:46.686308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:46.687680 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:46.687680 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1715148d-031f-4046-9671-1bba5fe25014 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 404 len: 111 microversion: 2.1 time: 0.037351 Sep 22 15:04:46.690946 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 448/882] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:46 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:46.694906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a68573c1-6f26-40cd-bc5f-639f6edc0b56 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '.version_select at 0x7f77e632a310>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:46.714860 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a68573c1-6f26-40cd-bc5f-639f6edc0b56 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664219446" status: 202 len: 0 microversion: 2.1 time: 0.024564 Sep 22 15:04:46.715451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 435/883] 10.222.0.26 () {58 vars in 1221 bytes} [Thu Sep 22 15:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664219446 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:04:48.492661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:48.493074 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:48.499741 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:48.500231 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:48.500666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:48.501375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:48.501827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:48.502247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:48.519698 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 HTTP/1.1 Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:04:48.521263 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.522801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '3591de7f-0312-4d50-8be9-b965fb09e050'} Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:48.523735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.525217 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.527094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:48.527094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-276802ce-ef56-4802-82f8-252d25ef96bf tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 404 len: 111 microversion: 2.1 time: 0.034129 Sep 22 15:04:48.527094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 449/884] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:04:48 2022] DELETE /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:48.532370 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:48.533106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 3591de7f-0312-4d50-8be9-b965fb09e050] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:48.539841 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:48.540323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:48.540755 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:48.541460 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:48.541907 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:48.542332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:48.555402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 HTTP/1.1 Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:04:48.557032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.558646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '3591de7f-0312-4d50-8be9-b965fb09e050'} Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:48.559804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. Sep 22 15:04:48.561277 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:48.562945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance 3591de7f-0312-4d50-8be9-b965fb09e050 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:48.562945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1b860029-a0b1-489c-bacb-603bdefe5999 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050" status: 404 len: 111 microversion: 2.1 time: 0.031094 Sep 22 15:04:48.562945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 436/885] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:48 2022] GET /compute/v2.1/servers/3591de7f-0312-4d50-8be9-b965fb09e050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:49.713948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:49.714446 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:49.721623 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.722115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.722547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.723275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.723728 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.724157 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.738082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 HTTP/1.1 Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:04:49.739674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.741275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'a4ac3fbb-deaf-4c39-9620-7db9ced29124'} Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:49.742116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.743573 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.744943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:49.744943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9267f48a-c7d8-448e-8aed-8344807a8f9c tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 404 len: 111 microversion: 2.1 time: 0.031289 Sep 22 15:04:49.744943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 450/886] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:04:49 2022] DELETE /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:49.749966 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:49.750584 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: a4ac3fbb-deaf-4c39-9620-7db9ced29124] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:49.757319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.757723 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.758161 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.758930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.759389 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.759830 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.775023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 HTTP/1.1 Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:04:49.776587 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.778131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'a4ac3fbb-deaf-4c39-9620-7db9ced29124'} Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:49.782837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. Sep 22 15:04:49.784256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.785509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance a4ac3fbb-deaf-4c39-9620-7db9ced29124 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:49.785509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3f1d63b7-828d-4725-87c3-05d82cd4cf3d tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124" status: 404 len: 111 microversion: 2.1 time: 0.031835 Sep 22 15:04:49.785509 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 437/887] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:49 2022] GET /compute/v2.1/servers/a4ac3fbb-deaf-4c39-9620-7db9ced29124 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:49.789531 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:49.789949 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:49.796454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.796946 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.797389 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.798113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.798632 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.799014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.813674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 HTTP/1.1 Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:04:49.815340 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.816871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '94107fe0-4109-4907-9e8c-2f48a0b6ea23'} Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:49.821067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.822504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.824066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:49.824066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-81e488e9-fb90-44ac-9b0b-0184b955c4d6 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 404 len: 111 microversion: 2.1 time: 0.031960 Sep 22 15:04:49.824066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 451/888] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:04:49 2022] DELETE /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:49.825793 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:49.826829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: 94107fe0-4109-4907-9e8c-2f48a0b6ea23] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:49.833151 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.833643 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.834084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.835085 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:49.835543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:49.835969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:49.851332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 HTTP/1.1 Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:04:49.852918 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.855231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '94107fe0-4109-4907-9e8c-2f48a0b6ea23'} Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:49.856489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. Sep 22 15:04:49.858833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:49.861471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance 94107fe0-4109-4907-9e8c-2f48a0b6ea23 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:49.861471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-159eb828-a7ef-4a02-892c-4d7439952f8b tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23" status: 404 len: 111 microversion: 2.1 time: 0.032596 Sep 22 15:04:49.861471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 438/889] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:49 2022] GET /compute/v2.1/servers/94107fe0-4109-4907-9e8c-2f48a0b6ea23 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:51.007153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:51.007654 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:51.014004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:51.014481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:51.014963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:51.015658 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:51.016112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:51.016538 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:51.030297 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 HTTP/1.1 Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:04:51.031934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.033515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'fd5971c6-d2d8-4674-a079-4a4856e13fb6'} Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:51.034417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.035910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.037316 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:51.037316 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-70eae78a-af70-43c1-8bce-2141a60ae099 tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 404 len: 111 microversion: 2.1 time: 0.030199 Sep 22 15:04:51.037316 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 452/890] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:04:51 2022] DELETE /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:51.041802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:51.042406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] [instance: fd5971c6-d2d8-4674-a079-4a4856e13fb6] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:51.049469 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:51.049938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:51.050364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:51.051071 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:51.051517 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:51.051936 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:51.065363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] HTTP exception thrown: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Request method failure captured: Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 HTTP/1.1 Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgJ6pf1yu9xGOvbQtxcSWfwCwi8TJ9hyka64gaGeiLXLTK_PkePRPrYTIywYNsMgGJQZPzFPExXRsqwm8wrmqFJ81MAIPew-maRt_LQlvgohgVPRTK7vdxhhGQbYx7TCpoSfARDdHAyXKZDrrSrIrQTMETYoi8U469o-zpQ_ABNhhk Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:04:51.066931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dc8a4487033d4e4aa231cc5873def0cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: dc8a4487033d4e4aa231cc5873def0cf Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1476954961 Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: f298f0c6a9e44efba2a1e2fc648a0f5d Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeNegativeTest-1476954961-project Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.068514 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'fd5971c6-d2d8-4674-a079-4a4856e13fb6'} Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:04:51.069402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. Sep 22 15:04:51.070900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:04:51.072171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] Returning 404 to user: Instance fd5971c6-d2d8-4674-a079-4a4856e13fb6 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:04:51.072171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bdc42b5f-5d0f-4cef-bcda-76ab5f3294dc tempest-AttachVolumeNegativeTest-1476954961 tempest-AttachVolumeNegativeTest-1476954961-project] 10.222.0.26 "GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6" status: 404 len: 111 microversion: 2.1 time: 0.030291 Sep 22 15:04:51.072171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 439/891] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:04:51 2022] GET /compute/v2.1/servers/fd5971c6-d2d8-4674-a079-4a4856e13fb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:04:59.730160 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:04:59.731381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:04:59.738635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=34 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:04:59.741164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:59.741874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:59.742832 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:59.743997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:04:59.745315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:04:59.745900 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:04:59.803572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e28b983c-99b2-488c-a946-a8b6770474d1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/ips" status: 200 len: 147 microversion: 2.1 time: 0.327541 Sep 22 15:04:59.804138 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 453/892] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:04:59 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/ips => generated 147 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:05:01.334460 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01e414ae-7bf0-459d-b19e-452b42f04733"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:01.337281 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:01.344823 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:01.345481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:01.347146 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:01.348023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:01.348567 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:01.349279 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:01.349775 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:01.350203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:01.875394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f3aa504d-94e5-4915-90a3-c5c19b579998 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553422 Sep 22 15:05:01.876044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 440/893] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:05:01 2022] POST /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:11.909645 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:11.920061 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:11.928467 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:11.929460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=23 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:11.931201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:11.931992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:11.932833 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:11.934064 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:11.935136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:11.935841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:11.980418 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-cc506c10-19e7-4de9-b365-8a048bd89975 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074578 Sep 22 15:05:11.982247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 454/894] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:05:11 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:11.991240 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:11.992000 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:11.997205 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:11.998114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:12.018746 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:12.019511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:12.022115 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:12.023980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:12.024488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:12.024967 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:12.089486 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fd79ae72-0f53-4912-9f66-446ba4223ad4 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/01e414ae-7bf0-459d-b19e-452b42f04733" status: 200 len: 194 microversion: 2.1 time: 0.099750 Sep 22 15:05:12.090003 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 441/895] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Sep 22 15:05:11 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/01e414ae-7bf0-459d-b19e-452b42f04733 => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:13.562630 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b7d6ec3-a6b9-4bca-a50c-6e28585eca17"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:13.565893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:13.572820 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:13.573488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:13.574116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:13.575061 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:13.575683 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:13.576356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:13.852719 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0d68ad59-3187-4d7d-8df8-46a7cc71c990 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "POST /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294206 Sep 22 15:05:13.853575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 455/896] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:05:13 2022] POST /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:16.655681 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bb8f6274-d05b-4abf-8a07-6be5e9d66915 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Action: 'create', calling method: .version_select at 0x7f77e6131c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1206888207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUsnCd01kEzxP68qTgy+kwsL9+fqvgLYbQR0aAxutlBO8YtyBceqT1wppXHz0ThXGZXtH4g8MCLHisis+rleY8fyqCjfddBGIoV8XU9BGuxj2/Sj+9wxyOA6TCxorz6Ig=="}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:16.672750 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-bb8f6274-d05b-4abf-8a07-6be5e9d66915 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Getting quotas for project 3a021020e4254a54b5892a11537a4807. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:05:16.676576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-bb8f6274-d05b-4abf-8a07-6be5e9d66915 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Getting quotas for user 59c1a8f322724f6490fe244c2704e1dd and project 3a021020e4254a54b5892a11537a4807. Resources: {'key_pairs'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:05:16.700937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bb8f6274-d05b-4abf-8a07-6be5e9d66915 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049590 Sep 22 15:05:16.701520 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 442/897] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:05:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:16.804923 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1714203783", "imageRef": "db773ab9-1734-494a-9492-aa82bcf8ac37", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1206888207", "networks": [{"uuid": "1d2ad964-e32c-4bc4-abf7-b9e83c70db84"}]}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:16.861968 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.network.neutron [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] validate_networks() for [('1d2ad964-e32c-4bc4-abf7-b9e83c70db84', None, None, None, None, None)] {{(pid=120694) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:05:17.257675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Flavor limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:05:17.258192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Image limits 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:05:17.258692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Flavor pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:05:17.259122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Image pref 0:0:0 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:05:17.259535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.virt.hardware [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:05:17.270261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:17.270865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:17.271313 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:17.272169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:17.273012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:17.273824 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:17.292292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Getting quotas for project 3a021020e4254a54b5892a11537a4807. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:05:17.296225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Getting quotas for user 59c1a8f322724f6490fe244c2704e1dd and project 3a021020e4254a54b5892a11537a4807. Resources: {'instances', 'cores', 'ram'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:05:17.307165 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Going to run 1 instances... {{(pid=120694) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:05:17.309993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db773ab9-1734-494a-9492-aa82bcf8ac37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:05:17.357598 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-460d3775-1906-4eba-9417-f80fcdd00431 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557134 Sep 22 15:05:17.358621 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 456/898] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 15:05:17.369865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2a6b9012-d0d5-4a48-bd5d-ba53f7e4bc1e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:17.370482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2a6b9012-d0d5-4a48-bd5d-ba53f7e4bc1e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:17.432542 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2a6b9012-d0d5-4a48-bd5d-ba53f7e4bc1e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:17.441672 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2a6b9012-d0d5-4a48-bd5d-ba53f7e4bc1e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1259 microversion: 2.1 time: 0.075795 Sep 22 15:05:17.442981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 443/899] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:17 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:05:18.468159 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:18.468754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:18.478139 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:18.478631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:18.479097 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:18.479837 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:18.491543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:18.492189 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:18.586569 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:18.598449 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fb2e6acf-30b6-480f-bb81-0b0c50456c89 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1319 microversion: 2.1 time: 0.135960 Sep 22 15:05:18.599470 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 457/900] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:18 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:19.624173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:19.624696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:19.654767 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:19.655338 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:19.655779 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:19.656705 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:19.657323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:19.658061 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:19.921270 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:19.933205 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-27bddc30-0887-4b08-97d5-52ae290ff497 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.313732 Sep 22 15:05:19.934187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 444/901] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:19 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:05:20.282094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:20.285653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:20.293878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.294814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.295429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:20.296319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.296776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.297205 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:20.337667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7e3ced83-2a4b-4582-a90b-d28f1d66c362 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060903 Sep 22 15:05:20.338252 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 458/902] 10.222.0.26 () {60 vars in 1343 bytes} [Thu Sep 22 15:05:20 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:20.455372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:20.456147 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:20.469361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.472832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.473384 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:20.474221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.475122 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.475662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:20.509380 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:05:20.608340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-19c98afc-41ca-474f-87f7-6ce709a369a0 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 204 len: 0 microversion: 2.20 time: 0.157462 Sep 22 15:05:20.609345 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 445/903] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 22 15:05:20 2022] DELETE /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 22 15:05:20.617965 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:20.618845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:20.628420 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.629259 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.629707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:20.630550 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.634149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.634637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:20.801012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:20.810101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:20.819681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:20.831280 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ae8304ee-f689-4504-bf0c-2a07b35a732c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.217381 Sep 22 15:05:20.831811 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 459/904] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:20 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:20.977851 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:20.978855 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:20.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.992323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.993154 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:20.994044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:20.994650 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:20.995252 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:21.163944 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:21.172898 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-855f3344-4d4f-47e9-9e3e-1ff3b081039d tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.199886 Sep 22 15:05:21.173476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 446/905] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:20 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:21.873690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:21.876978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:21.892865 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:21.893614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:21.894202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:21.894977 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:21.895442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:21.895880 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:22.096042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:22.106376 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:22.107939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:22.109067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ef8b7f68-aa8b-417f-8ea9-d1014b5974a4 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.248627 Sep 22 15:05:22.109676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 460/906] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:21 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:22.196055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:22.196789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:22.205027 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:22.205515 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:22.205958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:22.206661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:22.207150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:22.207571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:22.349225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:22.357303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-25c5e679-ac05-468c-99e7-accad452e631 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.165128 Sep 22 15:05:22.358220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 447/907] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:22 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:23.139254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:23.139950 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:23.146443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:23.147471 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:23.148017 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:23.149504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:23.149504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:23.150050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:23.338672 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:23.350004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:23.351519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:23.352690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a60f59d7-6ec4-400e-abba-a010ac8c6d5a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.219131 Sep 22 15:05:23.353240 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 461/908] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:23 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:23.385696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:23.386290 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:23.396097 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:23.396598 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:23.397039 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:23.397750 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:23.398218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:23.398629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:23.559389 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:23.567528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8a7f72d9-e78c-4ead-ab67-4f97e97b21f6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.185902 Sep 22 15:05:23.568098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 448/909] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:23 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:24.379397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:24.380009 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:24.387010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:24.387501 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:24.388008 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:24.388725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:24.389361 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:24.389794 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:24.546988 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:24.560303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:24.561858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:24.563197 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b5eb8cbf-7d1a-4cdb-acc5-6cadd2281e2b tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.187587 Sep 22 15:05:24.564087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 462/910] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:24 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:24.593199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:24.595078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:24.603666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:24.604252 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:24.604765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:24.605583 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:24.606109 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:24.607318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:24.812202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:24.824476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4101f54d-1454-4638-befb-81022c3c69ff tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.236628 Sep 22 15:05:24.825817 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 449/911] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:24 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:25.589855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:25.592002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:25.608016 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:25.608804 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:25.609413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:25.610309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:25.610782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:25.611212 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:25.837921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:25.855654 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:25.857152 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:25.860850 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:25.864575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:25.868128 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d8973ef4-aa03-4c0c-abd4-25eb37b43559 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.282789 Sep 22 15:05:25.877644 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 463/912] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:25 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:25.887063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:25.887063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:25.887063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:25.887063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:25.887529 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:25.887529 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:26.070863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:26.081831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-485a32b9-2b3f-4de5-9658-ac9e94aeeb3c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.231934 Sep 22 15:05:26.083021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 450/913] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:25 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:05:26.905437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:26.906269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:26.915141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:26.915141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:26.915141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:26.915765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:26.916122 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:26.916639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:27.112274 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:27.113754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:27.120819 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:27.121665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:27.122909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:27.123863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:27.124549 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:27.125191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:27.152218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:27.162571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:27.164202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:27.165490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-91ed31fd-4a70-4bb0-8000-d16ba23ac3ad tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.264400 Sep 22 15:05:27.166181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 464/914] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:26 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:27.357424 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:27.364964 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-252cddfc-015d-4833-ba94-3cf6a83f6cc7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.257277 Sep 22 15:05:27.365543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 451/915] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:27 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:28.196990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:28.198955 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:28.220806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:28.225653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=6 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:28.227678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:28.228806 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:28.229902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:28.230686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:28.231213 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:28.232404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:28.394143 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:28.394854 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:28.398544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:28.405459 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:28.406240 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:28.407058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:28.409971 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:28.410800 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:28.411449 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:28.715553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:28.720913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:28.723334 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:28.725145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a076d6cc-3efc-462d-80a1-bf9462fda815 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.536033 Sep 22 15:05:28.728216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 465/916] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:28 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:28.733506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-7f2ef2c2-1fa7-464c-adf0-8fcf382b4dd7 req-7a4b0eeb-291d-4ecb-bb39-541e6db8fca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edcfcab-f6f4-40f2-9d8c-840434107d5b", "tag": "6a8a7c35-f0e8-44f3-8147-c1fc3408921d"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:28.749282 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-7f2ef2c2-1fa7-464c-adf0-8fcf382b4dd7 req-7a4b0eeb-291d-4ecb-bb39-541e6db8fca7 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:28.749813 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-7f2ef2c2-1fa7-464c-adf0-8fcf382b4dd7 req-7a4b0eeb-291d-4ecb-bb39-541e6db8fca7 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:28.750180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-7f2ef2c2-1fa7-464c-adf0-8fcf382b4dd7 req-7a4b0eeb-291d-4ecb-bb39-541e6db8fca7 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:28.753310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:28.762581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-87514ad0-9ec8-41e8-8d91-a94bb658d2a5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.373595 Sep 22 15:05:28.769919 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-7f2ef2c2-1fa7-464c-adf0-8fcf382b4dd7 req-7a4b0eeb-291d-4ecb-bb39-541e6db8fca7 service nova] Creating event network-changed:6a8a7c35-f0e8-44f3-8147-c1fc3408921d for instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b on hv-cinder-84456 Sep 22 15:05:28.775054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-7f2ef2c2-1fa7-464c-adf0-8fcf382b4dd7 req-7a4b0eeb-291d-4ecb-bb39-541e6db8fca7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045586 Sep 22 15:05:28.776746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 466/917] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:28.784023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 452/918] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:28 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:29.755549 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:29.756426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:29.766605 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:29.767175 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:29.767812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:29.768905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:29.770856 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:29.772327 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:29.789394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:29.790753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:29.802132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:29.803887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:29.809089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:29.810665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:29.811401 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:29.811856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:30.205767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:30.215405 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:30.217155 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:30.218546 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-243b3551-16c2-433b-8b70-70f8517e7a3d tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1723 microversion: 2.20 time: 0.470035 Sep 22 15:05:30.219336 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 467/919] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:29 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1723 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 15:05:30.258970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:30.269812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:30.272019 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:30.277983 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4ddbc5ed-a802-414e-85f8-54639e4b6460 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.492354 Sep 22 15:05:30.278579 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 453/920] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:29 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:05:30.289309 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:30.290211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:30.292767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:30.296409 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:30.296746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:30.297211 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:30.352560 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a0d06e1a-ae4c-4658-af4a-98af75eaed34 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.086863 Sep 22 15:05:30.360246 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 468/921] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:05:30 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:05:30.499758 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:30.500303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:30.506342 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:30.507187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:30.507816 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:30.508726 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:30.509487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:30.510078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:30.547811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-884eef70-9c92-4a19-afb8-156d10cb7242 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/01e414ae-7bf0-459d-b19e-452b42f04733" status: 200 len: 194 microversion: 2.1 time: 0.053076 Sep 22 15:05:30.554097 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 454/922] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Sep 22 15:05:30 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/01e414ae-7bf0-459d-b19e-452b42f04733 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:30.561545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:30.562973 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:30.570796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:30.572169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:30.572831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:30.574381 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:30.576910 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:30.577625 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:30.703041 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lazy-loading 'services' on Instance uuid e04af519-b484-47b3-a43c-e755c25e50ab {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:05:30.796758 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:30.810496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-776fd543-8dcf-41ad-8b8a-e060a74e9747 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/01e414ae-7bf0-459d-b19e-452b42f04733" status: 202 len: 0 microversion: 2.1 time: 0.254481 Sep 22 15:05:30.811412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 469/923] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:05:30 2022] DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/01e414ae-7bf0-459d-b19e-452b42f04733 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:05:31.245144 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:31.245747 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:31.260421 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:31.260906 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:31.261339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:31.262050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:31.262547 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:31.262998 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:31.312112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:31.312827 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:31.325012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:31.325504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:31.325934 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:31.326648 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:31.327129 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:31.327551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:31.542101 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:31.553325 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:31.566678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:31.568059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-82e8cae3-3364-4552-959f-4600685f58b1 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1655 microversion: 2.20 time: 0.327032 Sep 22 15:05:31.578772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 455/924] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:31 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1655 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:31.721512 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:31.729563 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7695f8a7-1f75-4052-a5f1-e1bc31c00700 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.423603 Sep 22 15:05:31.733889 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 470/925] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:31 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:31.859809 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-eb7d0ae6-d72f-4fe6-8d91-cc7734c44bb5 req-05d43362-5c52-49bd-84bd-97619e48e420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25eaa6dc-ecc8-44ac-a552-9753ed98baa4", "name": "network-vif-deleted", "tag": "2a4fb816-a034-43e4-973a-90bfa5151681"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:31.869951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-eb7d0ae6-d72f-4fe6-8d91-cc7734c44bb5 req-05d43362-5c52-49bd-84bd-97619e48e420 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:31.870753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-eb7d0ae6-d72f-4fe6-8d91-cc7734c44bb5 req-05d43362-5c52-49bd-84bd-97619e48e420 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:31.871378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-eb7d0ae6-d72f-4fe6-8d91-cc7734c44bb5 req-05d43362-5c52-49bd-84bd-97619e48e420 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:31.883802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-eb7d0ae6-d72f-4fe6-8d91-cc7734c44bb5 req-05d43362-5c52-49bd-84bd-97619e48e420 service nova] Creating event network-vif-deleted:2a4fb816-a034-43e4-973a-90bfa5151681 for instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 on hv-cinder-84456 Sep 22 15:05:31.889872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-eb7d0ae6-d72f-4fe6-8d91-cc7734c44bb5 req-05d43362-5c52-49bd-84bd-97619e48e420 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034326 Sep 22 15:05:31.891919 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 456/926] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:32.021822 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:32.023048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:32.030452 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.031227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.031789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.032586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.033151 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.033665 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.066053 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e3ded297-eccb-4fcb-8d84-392da2b83aca tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/8b7d6ec3-a6b9-4bca-a50c-6e28585eca17" status: 200 len: 194 microversion: 2.1 time: 0.048095 Sep 22 15:05:32.074135 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 471/927] 10.222.0.26 () {58 vars in 1413 bytes} [Thu Sep 22 15:05:32 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/8b7d6ec3-a6b9-4bca-a50c-6e28585eca17 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:32.079311 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:32.080165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:32.087661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.088209 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.088647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.089352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.089804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.090270 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.189508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lazy-loading 'services' on Instance uuid e04af519-b484-47b3-a43c-e755c25e50ab {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:05:32.417867 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:32.437450 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d83962c1-692a-432e-9da7-05940bcea3a5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/8b7d6ec3-a6b9-4bca-a50c-6e28585eca17" status: 202 len: 0 microversion: 2.1 time: 0.363530 Sep 22 15:05:32.454662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 457/928] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:05:32 2022] DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments/8b7d6ec3-a6b9-4bca-a50c-6e28585eca17 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:05:32.600225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:32.601112 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:32.611537 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.612943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.613528 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.615762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.617652 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.618156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.669260 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.669655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.671871 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.673205 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lazy-loading 'fault' on Instance uuid 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:05:32.722195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:32.732236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:32.733668 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23d683cdc90041b5b29767fa2e2107e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef8a9d089c9446697837d5ebe2154c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:32.734863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f86313a2-c978-4b5f-826d-fc8800336cc5 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 200 len: 1370 microversion: 2.20 time: 0.141988 Sep 22 15:05:32.735428 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 472/929] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:32 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 1370 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 15:05:32.758123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:32.759203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:32.770297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.771095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.771683 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.772568 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:32.773446 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:32.774023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:32.987301 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:32.996736 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-833bb9d1-1f06-49da-933c-6ac85ee2ddc8 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.243486 Sep 22 15:05:33.007448 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 458/930] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:32 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:33.735792 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:33.742174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:33.750337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:33.751184 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:33.751795 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:33.752695 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:33.753487 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:33.754330 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:33.764999 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:33.766334 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:33.784170 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:33.785567 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:33.786222 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:33.787188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:33.788954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:33.789680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:33.806561 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] HTTP exception thrown: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Request method failure captured: Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 HTTP/1.1 Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgMP8XPQv6owQvaZdj05Sofe_IjaSuYoI5ZV9EjSjIKXPiQPDFkqxsoK9alhn_kg8wReB7qczvch4JAee56qPi0pzSR_VDBOu4CZNkmI7ntTkE_SP4KrWHAotdxmSjUj_LIqeEydKPQXmBGeysDisuLqHoL0OgEfNPiR3-vqGnA5Go Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:05:33.808887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 23d683cdc90041b5b29767fa2e2107e2 Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:33.811237 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '25eaa6dc-ecc8-44ac-a552-9753ed98baa4'} Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:33.812508 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:33.816575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:33.827710 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Returning 404 to user: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:33.827979 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9ea10c6f-ed93-4ce8-b973-5aed1aada3d9 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103425 Sep 22 15:05:33.836083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 473/931] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:05:33 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 15:05:33.836341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a85567e9-0337-4220-9b22-54b51dfeffce tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 404 len: 111 microversion: 2.20 time: 0.072235 Sep 22 15:05:33.836341 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 459/932] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:33 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:05:33.851304 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7ac783db-90a0-47f3-8733-6ac5d8f9b828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '.version_select at 0x7f77e61ce0d0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:33.875984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7ac783db-90a0-47f3-8733-6ac5d8f9b828 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372792787" status: 204 len: 0 microversion: 2.20 time: 0.028322 Sep 22 15:05:33.877555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 474/933] 10.222.0.26 () {60 vars in 1262 bytes} [Thu Sep 22 15:05:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372792787 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 15:05:33.976329 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:33.979259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:33.987658 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:33.988274 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:33.988791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:33.989598 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:33.990129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:33.990633 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:34.022855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:34.023627 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:34.026537 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-75a34dfd-97cc-4bb6-9770-0849507041e8 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054568 Sep 22 15:05:34.027719 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 460/934] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:05:33 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 15:05:34.033550 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:34.037485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:34.040695 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:34.044253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:34.046935 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:34.047714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:34.136356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:34.136861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:34.143031 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:34.143781 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:34.144444 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:34.145386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:34.146173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:34.149168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:34.190640 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:05:34.258091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:34.270118 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-2713b721-97a5-4bc4-b9dc-9745de9f67ab tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.252421 Sep 22 15:05:34.271474 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 475/935] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:34 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:34.338165 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-32eaff1a-da4a-4b10-a535-82397292adf5 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 204 len: 0 microversion: 2.1 time: 0.205302 Sep 22 15:05:34.339232 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 461/936] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:05:34 2022] DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 15:05:34.348121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:34.348733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:34.354631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:34.355538 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:34.356703 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:34.357411 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:34.357858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:34.358489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:34.511773 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:34.521639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fc84c597-e1e2-4176-b105-1796261ed8dc tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1674 microversion: 2.1 time: 0.176934 Sep 22 15:05:34.522627 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 476/937] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:34 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:35.296544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:35.297692 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:35.311028 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:35.311536 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:35.311982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:35.312706 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:35.313345 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:35.313946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:35.485656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:35.497024 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-470cfce8-5ad1-4491-a1ef-c7b4b118fab7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.203549 Sep 22 15:05:35.514234 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 462/938] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:35 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:05:35.547691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:35.548397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:35.555493 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:35.556083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:35.556589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:35.557912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:35.558906 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:35.560499 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:35.734488 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:35.743565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-86b9ad8c-3915-4d8a-9bc7-f0c523a2e452 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1674 microversion: 2.1 time: 0.201221 Sep 22 15:05:35.744151 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 477/939] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:35 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:36.181719 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:36.182581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:36.190188 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.191023 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.191835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:36.192753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.193475 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.194094 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:36.217032 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] HTTP exception thrown: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Request method failure captured: Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 HTTP/1.1 Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgMP8XPQv6owQvaZdj05Sofe_IjaSuYoI5ZV9EjSjIKXPiQPDFkqxsoK9alhn_kg8wReB7qczvch4JAee56qPi0pzSR_VDBOu4CZNkmI7ntTkE_SP4KrWHAotdxmSjUj_LIqeEydKPQXmBGeysDisuLqHoL0OgEfNPiR3-vqGnA5Go Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:05:36.220601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 23d683cdc90041b5b29767fa2e2107e2 Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.222139 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '25eaa6dc-ecc8-44ac-a552-9753ed98baa4'} Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:36.226356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.227951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.231528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Returning 404 to user: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:36.232669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-129def84-234d-465b-b7da-4588deb9e12a tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 404 len: 111 microversion: 2.20 time: 0.055804 Sep 22 15:05:36.234031 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 463/940] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 22 15:05:36 2022] DELETE /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:05:36.241952 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:36.242681 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: 25eaa6dc-ecc8-44ac-a552-9753ed98baa4] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:36.252237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.254208 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.254767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:36.255619 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.258441 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.259607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:36.281320 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] HTTP exception thrown: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Request method failure captured: Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 HTTP/1.1 Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgMP8XPQv6owQvaZdj05Sofe_IjaSuYoI5ZV9EjSjIKXPiQPDFkqxsoK9alhn_kg8wReB7qczvch4JAee56qPi0pzSR_VDBOu4CZNkmI7ntTkE_SP4KrWHAotdxmSjUj_LIqeEydKPQXmBGeysDisuLqHoL0OgEfNPiR3-vqGnA5Go Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:05:36.284209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 23d683cdc90041b5b29767fa2e2107e2 Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.285697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '25eaa6dc-ecc8-44ac-a552-9753ed98baa4'} Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:36.286536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. Sep 22 15:05:36.288082 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:36.291542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Returning 404 to user: Instance 25eaa6dc-ecc8-44ac-a552-9753ed98baa4 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:36.293187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-40141ddd-2e89-4e1f-b054-3d9c22a93b0c tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4" status: 404 len: 111 microversion: 2.20 time: 0.055058 Sep 22 15:05:36.294523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 478/941] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:36 2022] GET /compute/v2.1/servers/25eaa6dc-ecc8-44ac-a552-9753ed98baa4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:05:36.524489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:36.525806 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:36.537778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.545871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.547290 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:36.548734 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.551002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.551955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:36.769655 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:36.773968 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:36.788042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.790417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.791920 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:36.794992 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:36.797446 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:36.798147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:37.055166 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:37.069555 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-bce5ebeb-42b2-406b-a189-f75c5a38fbd1 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1607 microversion: 2.1 time: 0.304796 Sep 22 15:05:37.070393 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 479/942] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:36 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1607 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:37.091411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:37.110493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-96e02134-113f-4a36-9e75-6b235654a9d5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.593166 Sep 22 15:05:37.111492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 464/943] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:36 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:37.544695 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:37.545653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:37.549734 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-e3af1af2-2584-403e-bb7f-2f655c9c1450 req-5e59e752-e0fa-49d5-8347-0da72a04a188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04af519-b484-47b3-a43c-e755c25e50ab", "name": "network-vif-deleted", "tag": "1f7c7d3b-9213-4cca-bf91-d234d168fcf1"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:37.560059 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:37.560939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:37.563329 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:37.566411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e3af1af2-2584-403e-bb7f-2f655c9c1450 req-5e59e752-e0fa-49d5-8347-0da72a04a188 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:37.566614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e3af1af2-2584-403e-bb7f-2f655c9c1450 req-5e59e752-e0fa-49d5-8347-0da72a04a188 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:37.567059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-e3af1af2-2584-403e-bb7f-2f655c9c1450 req-5e59e752-e0fa-49d5-8347-0da72a04a188 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:37.584861 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:37.587684 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:37.588184 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:37.596961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-e3af1af2-2584-403e-bb7f-2f655c9c1450 req-5e59e752-e0fa-49d5-8347-0da72a04a188 service nova] Creating event network-vif-deleted:1f7c7d3b-9213-4cca-bf91-d234d168fcf1 for instance e04af519-b484-47b3-a43c-e755c25e50ab on hv-cinder-84456 Sep 22 15:05:37.606807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-e3af1af2-2584-403e-bb7f-2f655c9c1450 req-5e59e752-e0fa-49d5-8347-0da72a04a188 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061957 Sep 22 15:05:37.612914 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 465/944] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:37.659877 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] HTTP exception thrown: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Request method failure captured: Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 HTTP/1.1 Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHgMP8XPQv6owQvaZdj05Sofe_IjaSuYoI5ZV9EjSjIKXPiQPDFkqxsoK9alhn_kg8wReB7qczvch4JAee56qPi0pzSR_VDBOu4CZNkmI7ntTkE_SP4KrWHAotdxmSjUj_LIqeEydKPQXmBGeysDisuLqHoL0OgEfNPiR3-vqGnA5Go Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:05:37.666766 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 23d683cdc90041b5b29767fa2e2107e2 Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.668439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'c45e6623-9952-42a0-b01e-85001ae14fd2'} Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:37.669198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.670416 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.671820 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Returning 404 to user: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:37.674002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a0adbe4c-0f77-44c1-991b-41762ca998d7 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 404 len: 111 microversion: 2.20 time: 0.133025 Sep 22 15:05:37.676289 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 480/945] 10.222.0.26 () {60 vars in 1280 bytes} [Thu Sep 22 15:05:37 2022] DELETE /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:05:37.684971 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:37.685681 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] [instance: c45e6623-9952-42a0-b01e-85001ae14fd2] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:37.700881 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:37.702820 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:37.704733 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:37.706591 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:37.707189 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:37.709733 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:37.751195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] HTTP exception thrown: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Request method failure captured: Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 HTTP/1.1 Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHgMP8XPQv6owQvaZdj05Sofe_IjaSuYoI5ZV9EjSjIKXPiQPDFkqxsoK9alhn_kg8wReB7qczvch4JAee56qPi0pzSR_VDBOu4CZNkmI7ntTkE_SP4KrWHAotdxmSjUj_LIqeEydKPQXmBGeysDisuLqHoL0OgEfNPiR3-vqGnA5Go Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:05:37.755474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aef8a9d089c9446697837d5ebe2154c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: aef8a9d089c9446697837d5ebe2154c8 Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-980327003 Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 23d683cdc90041b5b29767fa2e2107e2 Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-980327003-project Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.756942 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'c45e6623-9952-42a0-b01e-85001ae14fd2'} Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:37.757773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. Sep 22 15:05:37.759068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:37.760215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] Returning 404 to user: Instance c45e6623-9952-42a0-b01e-85001ae14fd2 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:37.762093 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5c0e5829-2e95-45db-8ce6-6af4d6cdda65 tempest-AttachVolumeShelveTestJSON-980327003 tempest-AttachVolumeShelveTestJSON-980327003-project] 10.222.0.26 "GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2" status: 404 len: 111 microversion: 2.20 time: 0.080046 Sep 22 15:05:37.764396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 466/946] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Sep 22 15:05:37 2022] GET /compute/v2.1/servers/c45e6623-9952-42a0-b01e-85001ae14fd2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 15:05:38.099678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:38.100295 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:38.110014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:38.110510 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:38.115154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:38.116556 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:38.117957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:38.121498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:38.135962 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:38.137018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:38.144387 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:38.144883 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:38.156329 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:38.158059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:38.160051 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:38.161730 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:38.241735 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:38.244243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:38.244928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:38.247366 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lazy-loading 'fault' on Instance uuid e04af519-b484-47b3-a43c-e755c25e50ab {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:05:38.422687 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da004a191bcd43b6a0865919813ec1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c7d5abbf8274516bf79312e3fa22f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:38.431485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5053a7be-dc09-40e1-b4cd-83abaa83c8a2 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 200 len: 1327 microversion: 2.1 time: 0.335836 Sep 22 15:05:38.434456 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 481/947] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:38 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 1327 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:38.534846 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:38.544233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-dcde14d0-5d52-4962-b74a-3f9c7277547c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.411809 Sep 22 15:05:38.561774 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 467/948] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:38 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:39.093707 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-08cb0e71-b553-44c4-9e1c-b2565d13c5ec req-ec5af89d-cf3a-4da1-8f13-8a60c1f01c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edcfcab-f6f4-40f2-9d8c-840434107d5b", "name": "network-vif-plugged", "status": "completed", "tag": "6a8a7c35-f0e8-44f3-8147-c1fc3408921d"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:39.109052 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-08cb0e71-b553-44c4-9e1c-b2565d13c5ec req-ec5af89d-cf3a-4da1-8f13-8a60c1f01c31 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:39.110244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-08cb0e71-b553-44c4-9e1c-b2565d13c5ec req-ec5af89d-cf3a-4da1-8f13-8a60c1f01c31 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:39.110973 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-08cb0e71-b553-44c4-9e1c-b2565d13c5ec req-ec5af89d-cf3a-4da1-8f13-8a60c1f01c31 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:39.147762 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-08cb0e71-b553-44c4-9e1c-b2565d13c5ec req-ec5af89d-cf3a-4da1-8f13-8a60c1f01c31 service nova] Creating event network-vif-plugged:6a8a7c35-f0e8-44f3-8147-c1fc3408921d for instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b on hv-cinder-84456 Sep 22 15:05:39.161678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-08cb0e71-b553-44c4-9e1c-b2565d13c5ec req-ec5af89d-cf3a-4da1-8f13-8a60c1f01c31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068096 Sep 22 15:05:39.165333 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 482/949] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:39.467002 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:39.467927 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:39.488543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:39.488543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:39.488543 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:39.489343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:39.490428 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:39.492100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:39.536020 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] HTTP exception thrown: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Request method failure captured: Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab HTTP/1.1 Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHhidFOXVJGdBOQPKIspkDCtoKuDy38Qm8cwYLL-DbROvv3HD8XCd-FPZHrW7qz-OtSQEb7VG-m8TGwoim9sahoPN7s1BQ373H9kzdSxUUXbhDBAsx8fpkFFh1YuQWWB7ZHeBq5WPoWwA_a2kmAwYYWIJbF_R8XyoOpsIZvl136JPnw Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:05:39.540789 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: da004a191bcd43b6a0865919813ec1a8 Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:39.542656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'e04af519-b484-47b3-a43c-e755c25e50ab'} Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:39.544343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:39.549418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:39.553331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Returning 404 to user: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:39.553331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-23d029bc-8ce4-442f-93fe-7089dfe1956e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 404 len: 111 microversion: 2.1 time: 0.089083 Sep 22 15:05:39.561115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9011a640-9c9e-4e95-bd1b-271b95647fd0 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '.version_select at 0x7f77e6125280>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:39.565634 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 468/950] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:39 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:05:39.585126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:39.591343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:39.614411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:39.615312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:39.620303 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9011a640-9c9e-4e95-bd1b-271b95647fd0 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601601552" status: 202 len: 0 microversion: 2.1 time: 0.065078 Sep 22 15:05:39.621402 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:39.627733 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:39.628701 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 483/951] 10.222.0.26 () {58 vars in 1218 bytes} [Thu Sep 22 15:05:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601601552 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:05:39.630990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:39.631701 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:40.139767 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:40.164594 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7e036cee-2676-4b33-8026-8f76ee067f43 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1359 microversion: 2.1 time: 0.591942 Sep 22 15:05:40.165171 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 469/952] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:39 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1359 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:40.699128 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7c550810-c962-44d0-99e2-a0391b061c2b tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Action: 'create', calling method: .version_select at 0x7f77e6275040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1833378044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LUjNMK19B+4APVHEvdZvVuNGSbZQMCJGtrWvAK2SzjoPOcCwOO4ZjI4LqozoLgHoQDJzGgOtSlOnIZnKKTiK1ffPE4o3iB3B1QZuOSNqJ7M4InFQE/VIBTelfJbfjMQ=="}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:40.732024 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-7c550810-c962-44d0-99e2-a0391b061c2b tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Getting quotas for project ab6ca70d427646d3b0a8ebd2838c807b. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:05:40.751066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-7c550810-c962-44d0-99e2-a0391b061c2b tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Getting quotas for user b761e143a6264e66aac0caac8cb46135 and project ab6ca70d427646d3b0a8ebd2838c807b. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:05:40.780690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7c550810-c962-44d0-99e2-a0391b061c2b tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.394281 Sep 22 15:05:40.789599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 484/953] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:05:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:41.189259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:41.189881 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:41.198777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:41.203180 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:41.203773 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:41.204579 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:41.205062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:41.205695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:41.433218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:41.453896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c8de6013-e206-41ad-8e5f-4e0bd74d306e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1548 microversion: 2.1 time: 0.268426 Sep 22 15:05:41.454638 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 470/954] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:41 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1548 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:41.481180 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:41.482199 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:41.492781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:41.493698 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:41.494398 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:41.496142 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:41.497196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:41.497945 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:41.729276 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:41.751881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-406526c4-607f-41e6-9a38-59efd6ea9cc6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1548 microversion: 2.1 time: 0.275840 Sep 22 15:05:41.756229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 485/955] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:41 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1548 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:41.776859 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:41.783924 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:41.784889 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Searching by: {'deleted': False, 'project_id': '3a021020e4254a54b5892a11537a4807'} {{(pid=120695) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 22 15:05:41.794723 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:41.798199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:41.800548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:41.810372 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:41.811542 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:41.813956 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:41.973106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.multi_cell_list [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120695) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 22 15:05:42.083810 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f4c0db31-fcd5-4afd-8a35-cfc199f8df28 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.311266 Sep 22 15:05:42.084950 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 471/956] 10.222.0.26 () {58 vars in 1125 bytes} [Thu Sep 22 15:05:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:42.098076 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:42.099114 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:42.107578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:42.112137 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:42.113147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:42.113807 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:42.118068 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:42.118863 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:42.119519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:42.724844 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:42.736490 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3fa58a5e-6bb0-44ea-858c-7c27eed0e2f7 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1548 microversion: 2.1 time: 0.642952 Sep 22 15:05:42.762021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 486/957] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:42 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1548 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:43.815413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:43.815950 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:43.825850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:43.830015 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:43.830548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:43.831036 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:43.831756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:43.832208 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:43.832622 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:43.871805 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] HTTP exception thrown: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Request method failure captured: Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab HTTP/1.1 Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHhidFOXVJGdBOQPKIspkDCtoKuDy38Qm8cwYLL-DbROvv3HD8XCd-FPZHrW7qz-OtSQEb7VG-m8TGwoim9sahoPN7s1BQ373H9kzdSxUUXbhDBAsx8fpkFFh1YuQWWB7ZHeBq5WPoWwA_a2kmAwYYWIJbF_R8XyoOpsIZvl136JPnw Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:05:43.875271 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: da004a191bcd43b6a0865919813ec1a8 Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:43.876980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'e04af519-b484-47b3-a43c-e755c25e50ab'} Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:43.877993 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:43.879382 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:43.884548 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Returning 404 to user: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:43.887590 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b9a0cf07-f332-4552-9ffd-f9a8a3ba2f1e tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 404 len: 111 microversion: 2.1 time: 0.075986 Sep 22 15:05:43.888662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 472/958] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:05:43 2022] DELETE /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:05:43.905847 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:43.914075 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: e04af519-b484-47b3-a43c-e755c25e50ab] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:43.928287 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:43.928963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:43.929551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:43.930572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:43.931794 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:43.932890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:43.994581 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] HTTP exception thrown: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Request method failure captured: Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab HTTP/1.1 Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHhidFOXVJGdBOQPKIspkDCtoKuDy38Qm8cwYLL-DbROvv3HD8XCd-FPZHrW7qz-OtSQEb7VG-m8TGwoim9sahoPN7s1BQ373H9kzdSxUUXbhDBAsx8fpkFFh1YuQWWB7ZHeBq5WPoWwA_a2kmAwYYWIJbF_R8XyoOpsIZvl136JPnw Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:05:43.997895 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: da004a191bcd43b6a0865919813ec1a8 Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:43.999536 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'e04af519-b484-47b3-a43c-e755c25e50ab'} Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:44.000454 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. Sep 22 15:05:44.001927 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:44.005090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Returning 404 to user: Instance e04af519-b484-47b3-a43c-e755c25e50ab could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:44.007383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c1a742d1-7066-407d-bccf-60bd89c3efd6 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab" status: 404 len: 111 microversion: 2.1 time: 0.113492 Sep 22 15:05:44.008405 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 487/959] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:43 2022] GET /compute/v2.1/servers/e04af519-b484-47b3-a43c-e755c25e50ab => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:05:44.584284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a444f723-0a13-43f5-95ec-ad6b894b7f3d"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:44.587254 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:44.594438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:44.594970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:44.595403 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:44.596098 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:44.596546 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:44.596972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:44.919560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-52f33f07-9dc4-4f2e-8689-0c9a03084ac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339079 Sep 22 15:05:44.920284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 473/960] 10.222.0.26 () {60 vars in 1323 bytes} [Thu Sep 22 15:05:44 2022] POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:45.246500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:45.247959 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:45.258656 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:45.259050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:45.259503 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:45.260321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:45.260772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:45.261997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:45.276776 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] HTTP exception thrown: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Request method failure captured: Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 HTTP/1.1 Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHhidFOXVJGdBOQPKIspkDCtoKuDy38Qm8cwYLL-DbROvv3HD8XCd-FPZHrW7qz-OtSQEb7VG-m8TGwoim9sahoPN7s1BQ373H9kzdSxUUXbhDBAsx8fpkFFh1YuQWWB7ZHeBq5WPoWwA_a2kmAwYYWIJbF_R8XyoOpsIZvl136JPnw Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:05:45.279083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: da004a191bcd43b6a0865919813ec1a8 Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.280641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': 'dea87b94-a17c-4cc6-b9f0-2113981000f9'} Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:45.281404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.282983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.286228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Returning 404 to user: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:45.286228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dcf87b45-15f4-46e0-b525-bd634244d615 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 404 len: 111 microversion: 2.1 time: 0.038050 Sep 22 15:05:45.286228 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 488/961] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:05:45 2022] DELETE /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 15:05:45.289889 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:45.290657 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] [instance: dea87b94-a17c-4cc6-b9f0-2113981000f9] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:45.298007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:45.298504 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:45.298971 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:45.299740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:45.300318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:45.300682 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:45.316757 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] HTTP exception thrown: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Request method failure captured: Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 HTTP/1.1 Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHhidFOXVJGdBOQPKIspkDCtoKuDy38Qm8cwYLL-DbROvv3HD8XCd-FPZHrW7qz-OtSQEb7VG-m8TGwoim9sahoPN7s1BQ373H9kzdSxUUXbhDBAsx8fpkFFh1YuQWWB7ZHeBq5WPoWwA_a2kmAwYYWIJbF_R8XyoOpsIZvl136JPnw Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:05:45.319084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c7d5abbf8274516bf79312e3fa22f6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 1c7d5abbf8274516bf79312e3fa22f6c Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1995806820 Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: da004a191bcd43b6a0865919813ec1a8 Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-AttachVolumeTestJSON-1995806820-project Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.320788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': 'dea87b94-a17c-4cc6-b9f0-2113981000f9'} Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:45.321760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. Sep 22 15:05:45.323179 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:05:45.324829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] Returning 404 to user: Instance dea87b94-a17c-4cc6-b9f0-2113981000f9 could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:45.324829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ffad14ed-3dc7-4bfb-a35c-3ca26897b038 tempest-AttachVolumeTestJSON-1995806820 tempest-AttachVolumeTestJSON-1995806820-project] 10.222.0.26 "GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9" status: 404 len: 111 microversion: 2.1 time: 0.036218 Sep 22 15:05:45.324829 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 474/962] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:45 2022] GET /compute/v2.1/servers/dea87b94-a17c-4cc6-b9f0-2113981000f9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:05:45.898756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0c449134-9ca5-4021-917f-17920880159e tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Action: 'create', calling method: .version_select at 0x7f77e6563670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2147216802", "metadata": {"Type": "work"}}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:46.266411 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0c449134-9ca5-4021-917f-17920880159e tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.523015 Sep 22 15:05:46.277085 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 489/963] 10.222.0.26 () {60 vars in 1156 bytes} [Thu Sep 22 15:05:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 535 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 22 15:05:46.302754 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-03d28ade-875d-4be3-a3cf-a794ffbdfb12 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Calling method '.version_select at 0x7f77e632f430>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:46.402848 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-03d28ade-875d-4be3-a3cf-a794ffbdfb12 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387" status: 200 len: 353 microversion: 2.1 time: 0.125062 Sep 22 15:05:46.403853 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 475/964] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 15:05:46 2022] GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:47.418383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-186842ec-f2f1-4fcb-92e4-7f1670a61049 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Calling method '.version_select at 0x7f77e6155820>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:47.478236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-186842ec-f2f1-4fcb-92e4-7f1670a61049 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387" status: 200 len: 354 microversion: 2.1 time: 0.064288 Sep 22 15:05:47.482913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 490/965] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 15:05:47 2022] GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387 => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:47.493580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f1cca937-0649-4d55-92fb-782fb782e785 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Calling method '.version_select at 0x7f77e61b58b0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:47.547492 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f1cca937-0649-4d55-92fb-782fb782e785 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387" status: 200 len: 354 microversion: 2.1 time: 0.059016 Sep 22 15:05:47.558929 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 476/966] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 15:05:47 2022] GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:47.569659 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-402a139d-2054-4695-a93d-7dff21c2ebd2 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Calling method '.version_select at 0x7f77e6352ee0>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:47.689196 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-402a139d-2054-4695-a93d-7dff21c2ebd2 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387" status: 202 len: 0 microversion: 2.1 time: 0.122908 Sep 22 15:05:47.690427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 491/967] 10.222.0.26 () {58 vars in 1248 bytes} [Thu Sep 22 15:05:47 2022] DELETE /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:05:47.704259 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-06339b48-316f-4405-8104-d239724d2425 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Calling method '.version_select at 0x7f77e655de50>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:47.772721 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-06339b48-316f-4405-8104-d239724d2425 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387" status: 200 len: 353 microversion: 2.1 time: 0.076955 Sep 22 15:05:47.779704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 477/968] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 15:05:47 2022] GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:48.798130 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ca504f80-0268-40ae-b14c-4c180c601ca1 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Calling method '.version_select at 0x7f77e6125670>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:48.837101 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-ca504f80-0268-40ae-b14c-4c180c601ca1 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] HTTP exception thrown: Volume 60c70357-9d51-4d16-a92c-57cb6d0a7387 could not be found. Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ca504f80-0268-40ae-b14c-4c180c601ca1 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Request method failure captured: Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387 HTTP/1.1 Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHnJ2TKKfQ_2qTkQv_1m-412Z-7KGPFXx5O14VQ9M_nmFs_0Q3So3B0Y_6J9N7hL1fjL_w3P5Cp6r5eFik2_YGM6v9_FW--CvME3ZQJ2tu9LyaeMNmMdUN49CkitzN3ZXyvin07QT11c97QtW3ZMXPyh47j32i3sodeBzE5bw_JKwdg Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 152196822dda4fb698e9e1a738f0e525 Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-VolumesGetTestJSON-1997843230 Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:05:48.839254 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/152196822dda4fb698e9e1a738f0e525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_152196822dda4fb698e9e1a738f0e525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/152196822dda4fb698e9e1a738f0e525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/152196822dda4fb698e9e1a738f0e525"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-VolumesGetTestJSON-1997843230 Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 152196822dda4fb698e9e1a738f0e525 Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-VolumesGetTestJSON-1997843230 Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-VolumesGetTestJSON-1997843230-project Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 019e9419b0d941d9b4a33c72b4c486a6 Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-VolumesGetTestJSON-1997843230-project Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Volume 60c70357-9d51-4d16-a92c-57cb6d0a7387 could not be found. Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '60c70357-9d51-4d16-a92c-57cb6d0a7387'} Sep 22 15:05:48.840902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60c70357-9d51-4d16-a92c-57cb6d0a7387 could not be found. (HTTP 404) (Request-ID: req-99fa6e3e-3742-4e5a-8f3a-83a8df9cac3f) Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:48.841888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 15:05:48.843356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60c70357-9d51-4d16-a92c-57cb6d0a7387 could not be found. Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 15:05:48.844747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60c70357-9d51-4d16-a92c-57cb6d0a7387 could not be found. Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60c70357-9d51-4d16-a92c-57cb6d0a7387 could not be found. Sep 22 15:05:48.846168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:05:48.848015 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ca504f80-0268-40ae-b14c-4c180c601ca1 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] Returning 404 to user: Volume 60c70357-9d51-4d16-a92c-57cb6d0a7387 could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:05:48.848888 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ca504f80-0268-40ae-b14c-4c180c601ca1 tempest-VolumesGetTestJSON-1997843230 tempest-VolumesGetTestJSON-1997843230-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387" status: 404 len: 109 microversion: 2.1 time: 0.059785 Sep 22 15:05:48.849496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 492/969] 10.222.0.26 () {58 vars in 1245 bytes} [Thu Sep 22 15:05:48 2022] GET /compute/v2.1/os-volumes/60c70357-9d51-4d16-a92c-57cb6d0a7387 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:05:51.654152 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:51.654937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:51.661127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:51.661511 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:51.662928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:51.662928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:51.663938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:51.663938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:51.822027 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:51.832253 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:51.834697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e391eccc-ebe3-4107-b528-91b86275ad2f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1594 microversion: 2.1 time: 0.186857 Sep 22 15:05:51.862842 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 478/970] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:51 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1594 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:05:54.410235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=4 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:54.416866 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-0d52536a-ff4b-4b31-94a3-595d595709d4 req-df9400a1-3293-4056-a4bd-4af4b2a1877d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edcfcab-f6f4-40f2-9d8c-840434107d5b", "tag": "6a8a7c35-f0e8-44f3-8147-c1fc3408921d"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:54.441789 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-0d52536a-ff4b-4b31-94a3-595d595709d4 req-df9400a1-3293-4056-a4bd-4af4b2a1877d service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:54.442359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-0d52536a-ff4b-4b31-94a3-595d595709d4 req-df9400a1-3293-4056-a4bd-4af4b2a1877d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:54.442710 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-0d52536a-ff4b-4b31-94a3-595d595709d4 req-df9400a1-3293-4056-a4bd-4af4b2a1877d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:54.471080 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-0d52536a-ff4b-4b31-94a3-595d595709d4 req-df9400a1-3293-4056-a4bd-4af4b2a1877d service nova] Creating event network-changed:6a8a7c35-f0e8-44f3-8147-c1fc3408921d for instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b on hv-cinder-84456 Sep 22 15:05:54.482527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-0d52536a-ff4b-4b31-94a3-595d595709d4 req-df9400a1-3293-4056-a4bd-4af4b2a1877d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072008 Sep 22 15:05:54.482527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 493/971] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:05:55.819924 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-613119125"}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:55.821013 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:55.822801 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:05:55.829556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:55.830037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:55.830468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:55.831197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:55.831652 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:55.832069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:55.963200 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.network.security_group_api [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Adding security group dbb399fc-d263-4d7a-a443-5bd82fe58d14 to port 6a8a7c35-f0e8-44f3-8147-c1fc3408921d Sep 22 15:05:56.328233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f9f75d65-8526-415b-adc2-eb5a6101eaf5 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.512495 Sep 22 15:05:56.329187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 479/972] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:05:55 2022] POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:05:56.339973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-c8a97ee1-7b6c-4767-96d5-9309668ee46f req-8055fdda-dbb9-42a6-a6e7-cdb55af17de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edcfcab-f6f4-40f2-9d8c-840434107d5b", "tag": "6a8a7c35-f0e8-44f3-8147-c1fc3408921d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:05:56.340296 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:05:56.341106 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:05:56.348308 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:56.348971 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:56.349438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c8a97ee1-7b6c-4767-96d5-9309668ee46f req-8055fdda-dbb9-42a6-a6e7-cdb55af17de8 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:56.349552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:56.349916 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c8a97ee1-7b6c-4767-96d5-9309668ee46f req-8055fdda-dbb9-42a6-a6e7-cdb55af17de8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:56.350364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c8a97ee1-7b6c-4767-96d5-9309668ee46f req-8055fdda-dbb9-42a6-a6e7-cdb55af17de8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:56.350575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:05:56.351155 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:05:56.351676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:05:56.362969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-c8a97ee1-7b6c-4767-96d5-9309668ee46f req-8055fdda-dbb9-42a6-a6e7-cdb55af17de8 service nova] Creating event network-changed:6a8a7c35-f0e8-44f3-8147-c1fc3408921d for instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b on hv-cinder-84456 Sep 22 15:05:56.368327 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-c8a97ee1-7b6c-4767-96d5-9309668ee46f req-8055fdda-dbb9-42a6-a6e7-cdb55af17de8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032681 Sep 22 15:05:56.368928 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 480/973] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:05:56.510442 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:05:56.519227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1385b24c-f097-40e8-b86d-2ce3c3459316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1759 microversion: 2.1 time: 0.185765 Sep 22 15:05:56.519794 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 494/974] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:05:56 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:00.702805 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1425716811", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1833378044", "security_groups": [{"name": "tempest-secgroup-smoke-749467982"}], "networks": [{"uuid": "638b2dfb-a65e-477b-88df-e32967a3af32"}], "block_device_mapping_v2": [{"uuid": "b8e00e7a-29e4-4914-a6a4-c2e23c4434e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:06:00.820887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] validate_networks() for [('638b2dfb-a65e-477b-88df-e32967a3af32', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:06:01.194556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:06:01.195010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:06:01.195488 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:06:01.195902 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:06:01.196310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:06:01.205784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:01.206319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:01.206708 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:01.207453 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:01.207912 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:01.208334 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:01.227449 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Getting quotas for project ab6ca70d427646d3b0a8ebd2838c807b. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:06:01.231463 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Getting quotas for user b761e143a6264e66aac0caac8cb46135 and project ab6ca70d427646d3b0a8ebd2838c807b. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:06:01.294106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:06:01.296765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8e00e7a-29e4-4914-a6a4-c2e23c4434e1',volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:06:01.529666 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-129f92fc-0802-4239-81cc-49a6402a8bf1 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.831458 Sep 22 15:06:01.530849 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 481/975] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:06:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:06:01.542499 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a75c1e09-3c57-4a91-8325-f81be3bc3e0f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:01.543593 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a75c1e09-3c57-4a91-8325-f81be3bc3e0f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:01.615600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a75c1e09-3c57-4a91-8325-f81be3bc3e0f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:01.626983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a75c1e09-3c57-4a91-8325-f81be3bc3e0f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1089 microversion: 2.1 time: 0.088930 Sep 22 15:06:01.627998 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 495/976] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:01 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1089 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:02.654146 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:02.655513 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:02.669802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:02.671156 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:02.671156 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:02.671704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:02.679077 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:02.679728 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:02.768256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:02.778726 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-052f55ac-d6e4-4fb1-909a-d3408066d330 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1205 microversion: 2.1 time: 0.131591 Sep 22 15:06:02.783295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 482/977] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:02 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1205 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:03.806636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:03.807839 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:03.815606 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:03.816153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:03.816588 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:03.817407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:03.817873 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:03.818305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:03.822608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=89 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:03.978667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:03.986764 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-f8e2a0de-59f0-42d6-b9b5-b11380e85b25 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.184474 Sep 22 15:06:03.990185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 496/978] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:03 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:04.354388 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-8f141630-114e-4952-8d58-a4c4601f0653 req-9bab2bdf-a804-4f5d-a1b6-d95bd0e08910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104a95d3-a8bf-4a19-b384-6e4b57df933b", "tag": "4bd73d72-82f1-4636-bfba-3b9e6631d2dd"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:06:04.366694 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8f141630-114e-4952-8d58-a4c4601f0653 req-9bab2bdf-a804-4f5d-a1b6-d95bd0e08910 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:04.367201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8f141630-114e-4952-8d58-a4c4601f0653 req-9bab2bdf-a804-4f5d-a1b6-d95bd0e08910 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:04.367629 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8f141630-114e-4952-8d58-a4c4601f0653 req-9bab2bdf-a804-4f5d-a1b6-d95bd0e08910 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:04.381601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-8f141630-114e-4952-8d58-a4c4601f0653 req-9bab2bdf-a804-4f5d-a1b6-d95bd0e08910 service nova] Creating event network-changed:4bd73d72-82f1-4636-bfba-3b9e6631d2dd for instance 104a95d3-a8bf-4a19-b384-6e4b57df933b on hv-cinder-84456 Sep 22 15:06:04.387336 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-8f141630-114e-4952-8d58-a4c4601f0653 req-9bab2bdf-a804-4f5d-a1b6-d95bd0e08910 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036873 Sep 22 15:06:04.388094 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 483/979] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:06:05.013894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:05.014636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:05.021304 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:05.021884 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:05.022322 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:05.023053 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:05.023504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:05.023928 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:05.172150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:05.180648 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-15bc6237-2f92-4b6d-b43e-04bb1175165e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.171063 Sep 22 15:06:05.181225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 497/980] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:05 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:06:06.205175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:06.205863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:06.212703 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:06.213178 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:06.214208 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:06.214921 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:06.215368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:06.215782 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:06.358680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:06.366669 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-e185f553-acc0-4450-b2be-128535953f5e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.165611 Sep 22 15:06:06.367355 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 484/981] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:06 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:07.389519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:07.390753 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:07.401393 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:07.402201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:07.402978 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:07.404125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:07.404906 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:07.405635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:07.552765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:07.560809 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-621c0446-e342-4d20-b8dc-fac005d15ddd tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.175903 Sep 22 15:06:07.561371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 498/982] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:07 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:08.583880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:08.584455 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:08.590901 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:08.591391 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:08.591825 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:08.592523 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:08.592972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:08.593392 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:08.729623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:08.738175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-df42b1d3-e92b-438f-83e2-b66ded869054 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.158710 Sep 22 15:06:08.748558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 485/983] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:08 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:09.762021 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:09.762902 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:09.769586 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:09.770107 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:09.770480 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:09.775184 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:09.775668 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:09.776113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:09.912813 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:09.920993 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b5f70a19-5f5b-467c-a9e1-28b248c42a4f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.163550 Sep 22 15:06:09.921643 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 499/984] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:09 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:10.943338 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:10.944099 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:10.951012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:10.951505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:10.951945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:10.952646 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:10.953105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:10.953533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:11.094060 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:11.102114 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ba9cb05c-534e-4573-87c3-b3c140fe414a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.162599 Sep 22 15:06:11.102659 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 486/985] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:10 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:12.124374 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:12.124995 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:12.127393 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:12.132746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:12.133238 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:12.133677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:12.134380 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:12.134870 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:12.135472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:12.282705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:12.290718 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-10c263ca-38a1-4049-8b61-7cfde4f73a7f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.170125 Sep 22 15:06:12.291391 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 500/986] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:12 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:13.311131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:13.311867 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:13.317715 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:13.318331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:13.331297 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:13.332821 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:13.333357 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:13.334496 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:13.335031 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:13.335558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:13.514093 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:13.523387 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a359d672-e4b2-463f-b233-f454a19296ff tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.213077 Sep 22 15:06:13.539351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 487/987] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:13 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:06:14.548448 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:14.549604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:14.556869 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=24 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:14.559913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:14.559913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:14.559913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:14.560893 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:14.561571 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:14.562312 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:14.743384 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:14.745309 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-229614f0-5260-4306-a6ab-842940263358 req-0940049c-db13-4dab-bda2-1f8f4c0b0a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104a95d3-a8bf-4a19-b384-6e4b57df933b", "name": "network-vif-plugged", "status": "completed", "tag": "4bd73d72-82f1-4636-bfba-3b9e6631d2dd"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:06:14.753568 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:14.756011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4dd41d0f-97ad-4c24-afb4-65d71b92726c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.212881 Sep 22 15:06:14.771885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 501/988] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:14 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:14.772398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-229614f0-5260-4306-a6ab-842940263358 req-0940049c-db13-4dab-bda2-1f8f4c0b0a3d service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:14.772398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-229614f0-5260-4306-a6ab-842940263358 req-0940049c-db13-4dab-bda2-1f8f4c0b0a3d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:14.772398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-229614f0-5260-4306-a6ab-842940263358 req-0940049c-db13-4dab-bda2-1f8f4c0b0a3d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:14.772398 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-229614f0-5260-4306-a6ab-842940263358 req-0940049c-db13-4dab-bda2-1f8f4c0b0a3d service nova] Creating event network-vif-plugged:4bd73d72-82f1-4636-bfba-3b9e6631d2dd for instance 104a95d3-a8bf-4a19-b384-6e4b57df933b on hv-cinder-84456 Sep 22 15:06:14.778245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-229614f0-5260-4306-a6ab-842940263358 req-0940049c-db13-4dab-bda2-1f8f4c0b0a3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Sep 22 15:06:14.779155 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 488/989] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:06:15.781230 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:15.781856 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:15.788686 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:15.789171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:15.789845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:15.790592 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:15.791099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:15.792261 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:15.941705 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:15.951164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-88e87edc-0719-4900-90a9-d7c52c0a1db6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1260 microversion: 2.1 time: 0.176039 Sep 22 15:06:15.952038 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 502/990] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:15 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:16.977716 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:16.979760 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:16.988285 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:16.989020 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:16.989727 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:16.990963 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:16.991415 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:16.991955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:17.135482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:17.143157 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5187221c-f3e3-490b-a8c4-f993f00e3160 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1443 microversion: 2.1 time: 0.170500 Sep 22 15:06:17.143740 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 489/991] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:16 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:17.165778 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:17.167516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:17.174675 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:17.175202 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:17.175639 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:17.176335 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:17.176963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:17.177392 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:17.347243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:17.356348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-6996bc5d-00b3-479f-8a22-16633abc1d72 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1443 microversion: 2.1 time: 0.194582 Sep 22 15:06:17.356936 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 503/992] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:17 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1443 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:19.564614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-b33e1d27-ea6b-43ea-8924-b35578b49f1c req-00850077-6349-412b-981d-3a160c9cf82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104a95d3-a8bf-4a19-b384-6e4b57df933b", "tag": "4bd73d72-82f1-4636-bfba-3b9e6631d2dd"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:06:19.575939 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b33e1d27-ea6b-43ea-8924-b35578b49f1c req-00850077-6349-412b-981d-3a160c9cf82b service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:19.576413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b33e1d27-ea6b-43ea-8924-b35578b49f1c req-00850077-6349-412b-981d-3a160c9cf82b service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:19.576832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-b33e1d27-ea6b-43ea-8924-b35578b49f1c req-00850077-6349-412b-981d-3a160c9cf82b service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:19.588817 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-b33e1d27-ea6b-43ea-8924-b35578b49f1c req-00850077-6349-412b-981d-3a160c9cf82b service nova] Creating event network-changed:4bd73d72-82f1-4636-bfba-3b9e6631d2dd for instance 104a95d3-a8bf-4a19-b384-6e4b57df933b on hv-cinder-84456 Sep 22 15:06:19.593891 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-b33e1d27-ea6b-43ea-8924-b35578b49f1c req-00850077-6349-412b-981d-3a160c9cf82b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032820 Sep 22 15:06:19.598395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 490/993] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:06:19.898853 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:06:19.903324 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:19.910348 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:19.910850 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:19.911670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:19.912564 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:19.913403 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:19.913983 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:20.019191 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4f1f7024-6c79-4116-badc-e0abaf6c940f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.124447 Sep 22 15:06:20.023215 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 504/994] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:06:19 2022] POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:06:20.029278 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:20.030203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:20.037689 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:20.038174 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:20.038613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:20.039358 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:20.039815 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:20.040261 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:20.185340 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:20.193642 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9294034b-fd96-4e20-af44-7a89843d8638 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1751 microversion: 2.1 time: 0.168940 Sep 22 15:06:20.194239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 491/995] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:20 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:21.222353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:21.224031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:21.240599 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:21.241803 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:21.249519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:21.249519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:21.249519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:21.249519 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:21.464800 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:21.473187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8a502483-eeaf-43d6-a86c-2e25b1b06e21 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1751 microversion: 2.1 time: 0.257516 Sep 22 15:06:21.473749 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 505/996] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:21 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:22.496952 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:22.497556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:22.503973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:22.504422 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:22.504857 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:22.505544 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:22.505995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:22.506413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:22.653218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:22.661896 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4b6dabb9-97e3-46f2-ad3f-c19b752527ac tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.169216 Sep 22 15:06:22.662522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 492/997] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:22 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:23.686487 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:23.687136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:23.693744 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:23.694632 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:23.694798 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:23.695383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:23.695840 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:23.696268 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:23.840052 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:23.848305 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ea95afb9-5265-47a8-9602-f98293fef7c4 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.165681 Sep 22 15:06:23.848890 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 506/998] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:23 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:24.871362 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:24.871981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:24.878704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:24.879221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:24.879661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:24.880354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:24.880856 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:24.881238 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:25.031033 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:25.039954 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-2de5dca0-a1cb-4ea5-9f3a-a4b43f5498fb tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.172494 Sep 22 15:06:25.040531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 493/999] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:24 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:26.065559 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:26.066169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:26.072886 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:26.073377 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:26.073801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:26.074516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:26.074986 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:26.075406 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:26.372547 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:26.381043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8d5e2bf6-9067-454c-bf3a-1199ece1cac6 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.319252 Sep 22 15:06:26.381916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 507/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:26 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:27.405128 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:27.405662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:27.412323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:27.412804 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:27.413232 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:27.413916 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:27.414359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:27.414825 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:27.418092 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=69 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:27.559204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:27.567505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-547c2ec5-b64e-4994-883d-277fd721ea8e tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.166239 Sep 22 15:06:27.568074 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 494/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:27 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:28.591068 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:28.591674 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:28.597997 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:28.598478 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:28.599012 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:28.599723 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:28.600169 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:28.600588 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:28.791772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:28.800510 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fe2e6680-4114-4d91-8377-83a86cbb0a00 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.213226 Sep 22 15:06:28.801412 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 508/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:28 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:06:29.826242 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:29.826996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:29.833539 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:29.834027 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:29.834468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:29.835195 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:29.835653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:29.836075 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:29.988718 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:29.998124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-98aeb914-c3cb-406a-bcf3-330eb3772fea tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.175902 Sep 22 15:06:30.003207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 495/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:29 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:31.025268 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:31.026535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:31.033221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:31.033702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:31.034134 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:31.034867 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:31.035315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:31.035734 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:31.192235 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:31.203319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8408d16b-2cba-4397-a366-13f46d2be29a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.181332 Sep 22 15:06:31.204326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 509/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:31 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:32.232634 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:32.233230 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:32.239603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:32.240078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:32.240507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:32.241187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:32.241634 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:32.242050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:32.389617 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:32.398158 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-eddfc41a-c256-409b-98c8-95e468428af2 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.170126 Sep 22 15:06:32.398770 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 496/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:32 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:33.422637 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:33.423270 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:33.430162 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:33.430649 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:33.431113 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:33.431878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:33.432262 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:33.432975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:33.585128 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:33.593560 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3a75bcf3-b610-4d64-87d8-b4d857d1cf04 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.174780 Sep 22 15:06:33.594123 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 510/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:33 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:34.617220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:34.617774 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:34.624190 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:34.624676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:34.625111 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:34.625811 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:34.626275 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:34.626690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:34.772987 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:34.782036 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-bb795bc5-77cb-4bf0-87d6-aac6bde31172 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.168727 Sep 22 15:06:34.782637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 497/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:34 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:35.806324 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:35.807008 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:35.814009 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:35.814492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:35.815299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:35.816141 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:35.816638 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:35.817070 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:35.822081 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:06:35.965224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:35.973755 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a21dc2d9-6938-49e6-8c25-64f6dbab2316 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.171472 Sep 22 15:06:35.974325 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 511/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:35 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:36.997383 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:36.998050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:37.004497 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:37.004977 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:37.005408 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:37.006197 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:37.006650 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:37.007100 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:37.154469 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:37.162713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f6a64e5e-dadf-4501-b6a6-19ac87d3de05 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.169309 Sep 22 15:06:37.163293 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 498/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:36 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:38.188542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:38.189370 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:38.196307 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:38.196797 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:38.197237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:38.197941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:38.198394 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:38.198855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:38.345960 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:38.354494 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-eb303433-5ed7-40fd-83b5-bfd7f0ca5552 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.171305 Sep 22 15:06:38.355100 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 512/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:38 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:39.379193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:39.379783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:39.386303 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:39.386854 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:39.387350 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:39.388049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:39.388498 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:39.388951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:39.532476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:39.540862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-07f0ff4e-2423-4074-8f19-e959c05c5951 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.165481 Sep 22 15:06:39.541366 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 499/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:39 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:40.564712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:40.565327 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:40.571881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:40.572362 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:40.572796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:40.573492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:40.573941 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:40.574369 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:40.724440 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:40.732574 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7b36b9ec-efb4-47e9-a3b9-df51d92f916c tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1756 microversion: 2.1 time: 0.171785 Sep 22 15:06:40.733144 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 513/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:40 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:06:41.756089 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:06:41.756714 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:06:41.763204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:41.763708 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:41.764128 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:41.764826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:06:41.765282 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:06:41.765812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:06:41.909118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:06:41.917432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-29b662c8-8770-4672-85b4-8969c7a04f86 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1759 microversion: 2.1 time: 0.165215 Sep 22 15:06:41.917992 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 500/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:06:41 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:07:17.477163 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-613119125"}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:07:17.477779 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:17.479850 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=25 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:07:17.480505 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=17 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:07:17.488413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:17.488922 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:17.489359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:17.490053 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:17.490506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:17.490975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:17.616042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.network.security_group_api [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Removing security group dbb399fc-d263-4d7a-a443-5bd82fe58d14 from port 6a8a7c35-f0e8-44f3-8147-c1fc3408921d Sep 22 15:07:17.925799 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b524e213-550c-4578-9067-b4272888caa3 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.452534 Sep 22 15:07:17.926552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 514/1014] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:07:17 2022] POST /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:07:17.932988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-77d54528-63d6-4281-80d3-425bf1cc1b98 req-722b5fd8-6448-4ab4-b1ff-fe8b98bfabf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edcfcab-f6f4-40f2-9d8c-840434107d5b", "tag": "6a8a7c35-f0e8-44f3-8147-c1fc3408921d"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:07:17.943784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=25 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:07:17.945317 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=41 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:07:17.948849 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77d54528-63d6-4281-80d3-425bf1cc1b98 req-722b5fd8-6448-4ab4-b1ff-fe8b98bfabf0 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:17.949532 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77d54528-63d6-4281-80d3-425bf1cc1b98 req-722b5fd8-6448-4ab4-b1ff-fe8b98bfabf0 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:17.950118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-77d54528-63d6-4281-80d3-425bf1cc1b98 req-722b5fd8-6448-4ab4-b1ff-fe8b98bfabf0 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:17.967676 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-77d54528-63d6-4281-80d3-425bf1cc1b98 req-722b5fd8-6448-4ab4-b1ff-fe8b98bfabf0 service nova] Creating event network-changed:6a8a7c35-f0e8-44f3-8147-c1fc3408921d for instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b on hv-cinder-84456 Sep 22 15:07:17.975481 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-77d54528-63d6-4281-80d3-425bf1cc1b98 req-722b5fd8-6448-4ab4-b1ff-fe8b98bfabf0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049210 Sep 22 15:07:17.976493 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 501/1015] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:07:19.348529 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:19.349074 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:19.355269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:19.355749 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:19.356181 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:19.356874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:19.357320 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:19.357741 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:19.440301 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lazy-loading 'services' on Instance uuid 0edcfcab-f6f4-40f2-9d8c-840434107d5b {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:07:19.514432 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3ac4bd9c-2a43-46af-bf1f-e108cd2a3081 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments/a444f723-0a13-43f5-95ec-ad6b894b7f3d" status: 202 len: 0 microversion: 2.1 time: 0.170958 Sep 22 15:07:19.515152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 515/1016] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:07:19 2022] DELETE /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments/a444f723-0a13-43f5-95ec-ad6b894b7f3d => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:07:19.524836 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:19.527117 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:19.533448 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:19.534019 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:19.534520 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:19.535269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:19.535695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:19.536113 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:19.567185 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f3e0a569-c935-4412-b79e-c9e13683dc6b tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047253 Sep 22 15:07:19.567746 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 502/1017] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:07:19 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:07:19.992218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-16fb7703-3e91-47fd-bf2e-047aa7e97e1d req-3b7c5bca-7cea-4c3c-8a34-f8b9aff9e1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edcfcab-f6f4-40f2-9d8c-840434107d5b", "tag": "6a8a7c35-f0e8-44f3-8147-c1fc3408921d"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:07:20.002658 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-16fb7703-3e91-47fd-bf2e-047aa7e97e1d req-3b7c5bca-7cea-4c3c-8a34-f8b9aff9e1cd service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:20.003174 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-16fb7703-3e91-47fd-bf2e-047aa7e97e1d req-3b7c5bca-7cea-4c3c-8a34-f8b9aff9e1cd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:20.003746 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-16fb7703-3e91-47fd-bf2e-047aa7e97e1d req-3b7c5bca-7cea-4c3c-8a34-f8b9aff9e1cd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:20.015525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-16fb7703-3e91-47fd-bf2e-047aa7e97e1d req-3b7c5bca-7cea-4c3c-8a34-f8b9aff9e1cd service nova] Creating event network-changed:6a8a7c35-f0e8-44f3-8147-c1fc3408921d for instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b on hv-cinder-84456 Sep 22 15:07:20.021210 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-16fb7703-3e91-47fd-bf2e-047aa7e97e1d req-3b7c5bca-7cea-4c3c-8a34-f8b9aff9e1cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032955 Sep 22 15:07:20.022005 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 516/1018] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:07:20.579265 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:20.582069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:20.588711 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:20.589314 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:20.589749 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:20.590442 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:20.590926 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:20.591352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:20.620220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-add7ce69-a4b4-4a27-9034-d84143242188 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044911 Sep 22 15:07:20.620778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 503/1019] 10.222.0.26 () {58 vars in 1302 bytes} [Thu Sep 22 15:07:20 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 15:07:20.634345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:20.634966 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:20.641109 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:20.641594 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:20.642031 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:20.643785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:20.644246 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:20.644677 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:20.729780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] HTTP exception thrown: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b is not attached to volume a444f723-0a13-43f5-95ec-ad6b894b7f3d Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Request method failure captured: Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: DELETE /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments/a444f723-0a13-43f5-95ec-ad6b894b7f3d HTTP/1.1 Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHmc6NwKbNV4RmxSoeEITs3eMouI9r6j2XBzt_TOSytMBo5zlovrCwb86x58TArMqXzfrfN9sLO9DZ6IanUmGp8qmy2d8KnNwVHGKlcZrbqxlyvWFl4nxT2lAOrqzJO4d750b6vtW917hP9P-xkQjA3uKdsrnI97iBz_Ok37fHO12Go Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 3a021020e4254a54b5892a11537a4807 Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-TestMinimumBasicScenario-930343885 Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:07:20.732193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a021020e4254a54b5892a11537a4807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a021020e4254a54b5892a11537a4807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a021020e4254a54b5892a11537a4807"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a021020e4254a54b5892a11537a4807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-TestMinimumBasicScenario-930343885 Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 3a021020e4254a54b5892a11537a4807 Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-TestMinimumBasicScenario-930343885 Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-TestMinimumBasicScenario-930343885-project Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 59c1a8f322724f6490fe244c2704e1dd Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-TestMinimumBasicScenario-930343885-project Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:07:20.733933 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b is not attached to volume a444f723-0a13-43f5-95ec-ad6b894b7f3d Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'server_id': '0edcfcab-f6f4-40f2-9d8c-840434107d5b', 'id': 'a444f723-0a13-43f5-95ec-ad6b894b7f3d'} Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a444f723-0a13-43f5-95ec-ad6b894b7f3d. Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:07:20.734855 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b is not attached to volume a444f723-0a13-43f5-95ec-ad6b894b7f3d Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b is not attached to volume a444f723-0a13-43f5-95ec-ad6b894b7f3d Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:20.736545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Returning 404 to user: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b is not attached to volume a444f723-0a13-43f5-95ec-ad6b894b7f3d {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:07:20.737661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-db24c2cc-f598-44dc-83a2-f79700dcfe20 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments/a444f723-0a13-43f5-95ec-ad6b894b7f3d" status: 404 len: 154 microversion: 2.1 time: 0.104388 Sep 22 15:07:20.737661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 517/1020] 10.222.0.26 () {58 vars in 1416 bytes} [Thu Sep 22 15:07:20 2022] DELETE /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b/os-volume_attachments/a444f723-0a13-43f5-95ec-ad6b894b7f3d => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:07:21.877531 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:21.878026 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:21.884359 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:21.884837 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:21.885274 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:21.885961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:21.886415 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:21.886869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:21.912182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:07:21.985119 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-860d7cbe-c49f-43bd-a811-441eac77152f tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 204 len: 0 microversion: 2.1 time: 0.111060 Sep 22 15:07:21.985735 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 504/1021] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:07:21 2022] DELETE /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:07:21.994667 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:21.995791 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:22.001270 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:22.001744 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:22.002229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:22.002892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:22.003346 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:22.003881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:22.137938 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:07:22.146119 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dd317d0b-4cf2-4232-ae63-45091bc06e7a tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1554 microversion: 2.1 time: 0.155430 Sep 22 15:07:22.146664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 518/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:07:21 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:07:23.172295 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:23.173006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:23.180306 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:23.180792 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:23.181227 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:23.181922 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:23.182381 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:23.182838 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:23.312680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:07:23.320427 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-0b6e5fb6-2a36-4423-b562-0ab6a64daf45 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1554 microversion: 2.1 time: 0.154532 Sep 22 15:07:23.320990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 505/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:07:23 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:07:24.113633 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-4ffc02b2-b42b-43fd-b216-2230a42ec742 req-9545ada3-28d2-44c1-99bd-c8a4f649ed97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edcfcab-f6f4-40f2-9d8c-840434107d5b", "name": "network-vif-deleted", "tag": "6a8a7c35-f0e8-44f3-8147-c1fc3408921d"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:07:24.127767 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4ffc02b2-b42b-43fd-b216-2230a42ec742 req-9545ada3-28d2-44c1-99bd-c8a4f649ed97 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:24.128500 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4ffc02b2-b42b-43fd-b216-2230a42ec742 req-9545ada3-28d2-44c1-99bd-c8a4f649ed97 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:24.129036 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-4ffc02b2-b42b-43fd-b216-2230a42ec742 req-9545ada3-28d2-44c1-99bd-c8a4f649ed97 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:24.142664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-4ffc02b2-b42b-43fd-b216-2230a42ec742 req-9545ada3-28d2-44c1-99bd-c8a4f649ed97 service nova] Creating event network-vif-deleted:6a8a7c35-f0e8-44f3-8147-c1fc3408921d for instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b on hv-cinder-84456 Sep 22 15:07:24.148688 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-4ffc02b2-b42b-43fd-b216-2230a42ec742 req-9545ada3-28d2-44c1-99bd-c8a4f649ed97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039302 Sep 22 15:07:24.149273 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 519/1024] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:07:24.344720 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:24.345352 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:24.351938 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:24.352414 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:24.352844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:24.353527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:24.353969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:24.354388 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:24.388123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:24.388604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:24.389069 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:24.389524 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lazy-loading 'fault' on Instance uuid 0edcfcab-f6f4-40f2-9d8c-840434107d5b {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:07:24.431745 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c1a8f322724f6490fe244c2704e1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a021020e4254a54b5892a11537a4807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:07:24.441865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-161e3f7c-a6af-4292-8f2f-827b7b0f72cc tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 200 len: 1349 microversion: 2.1 time: 0.099360 Sep 22 15:07:24.441865 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 506/1025] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:07:24 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:07:25.464913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:25.465635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [instance: 0edcfcab-f6f4-40f2-9d8c-840434107d5b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:07:25.472292 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:25.472765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:25.473193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:25.473880 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:07:25.474323 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:07:25.474773 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:07:25.488275 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] HTTP exception thrown: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b could not be found. Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Request method failure captured: Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b HTTP/1.1 Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHmc6NwKbNV4RmxSoeEITs3eMouI9r6j2XBzt_TOSytMBo5zlovrCwb86x58TArMqXzfrfN9sLO9DZ6IanUmGp8qmy2d8KnNwVHGKlcZrbqxlyvWFl4nxT2lAOrqzJO4d750b6vtW917hP9P-xkQjA3uKdsrnI97iBz_Ok37fHO12Go Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 3a021020e4254a54b5892a11537a4807 Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-TestMinimumBasicScenario-930343885 Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:07:25.489907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a021020e4254a54b5892a11537a4807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a021020e4254a54b5892a11537a4807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a021020e4254a54b5892a11537a4807"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a021020e4254a54b5892a11537a4807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-TestMinimumBasicScenario-930343885 Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 3a021020e4254a54b5892a11537a4807 Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-TestMinimumBasicScenario-930343885 Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-TestMinimumBasicScenario-930343885-project Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 59c1a8f322724f6490fe244c2704e1dd Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-TestMinimumBasicScenario-930343885-project Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b could not be found. Sep 22 15:07:25.491545 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '0edcfcab-f6f4-40f2-9d8c-840434107d5b'} Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b could not be found. Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:07:25.492496 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b could not be found. Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b could not be found. Sep 22 15:07:25.494089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:07:25.495492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Returning 404 to user: Instance 0edcfcab-f6f4-40f2-9d8c-840434107d5b could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:07:25.495492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-826c0a47-3277-4ea2-a07b-cd3cd684b295 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b" status: 404 len: 111 microversion: 2.1 time: 0.030899 Sep 22 15:07:25.495492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 520/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:07:25 2022] GET /compute/v2.1/servers/0edcfcab-f6f4-40f2-9d8c-840434107d5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:07:25.499995 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-baa1e3ef-fee2-42d9-a502-30c4b136f713 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] Calling method '.version_select at 0x7f77e62dd940>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:07:25.505123 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR oslo.messaging._drivers.impl_rabbit [None req-baa1e3ef-fee2-42d9-a502-30c4b136f713 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [c2b5dc0a-7b62-4bbb-8548-7d1a1986822b] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 15:07:26.512182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [None req-baa1e3ef-fee2-42d9-a502-30c4b136f713 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] [c2b5dc0a-7b62-4bbb-8548-7d1a1986822b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53608. Sep 22 15:07:26.530779 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-baa1e3ef-fee2-42d9-a502-30c4b136f713 tempest-TestMinimumBasicScenario-930343885 tempest-TestMinimumBasicScenario-930343885-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1206888207" status: 202 len: 0 microversion: 2.1 time: 1.034477 Sep 22 15:07:26.531361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 507/1027] 10.222.0.26 () {58 vars in 1272 bytes} [Thu Sep 22 15:07:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1206888207 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:08:24.858419 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:08:24.859124 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:24.861359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=14 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:08:24.862269 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:08:24.868525 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:24.869010 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:24.869445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:24.870147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:24.870600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:24.871045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:24.894812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.objects.instance [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lazy-loading 'flavor' on Instance uuid 104a95d3-a8bf-4a19-b384-6e4b57df933b {{(pid=120694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:08:24.967876 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-02fc742b-3852-4205-ad40-19c34582f3ce tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "POST /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b/action" status: 202 len: 0 microversion: 2.1 time: 0.113180 Sep 22 15:08:24.968434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 521/1028] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:08:24 2022] POST /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:08:24.975178 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:08:24.975923 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:08:24.980339 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:24.980946 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:24.989560 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:24.990095 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:24.990595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:24.991308 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:24.991784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:24.992204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:25.362500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:25.370378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b82dac53-28c2-4749-a420-d55ce1a2a87e tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.397500 Sep 22 15:08:25.370990 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 508/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:24 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:26.395091 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:26.396491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:26.404635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:26.405125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:26.405633 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:26.406452 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:26.406945 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:26.407422 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:26.607857 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:26.615618 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-03367fdd-bf5c-4827-b04a-2ea19949ec7c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.225361 Sep 22 15:08:26.616166 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 522/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:26 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:27.638268 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:27.638960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:27.645203 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:27.645680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:27.646115 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:27.646827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:27.647284 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:27.647712 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:27.781476 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:27.789863 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-364ea22c-44cc-4be4-b4d9-740133a802ee tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.155673 Sep 22 15:08:27.790438 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 509/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:27 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:28.813114 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:28.813666 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:28.820335 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:28.820816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:28.821253 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:28.821950 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:28.822402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:28.822862 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:28.951576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:28.960331 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e7206023-53f4-4cff-b855-18de138eca19 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.151170 Sep 22 15:08:28.960886 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 523/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:28 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:29.984022 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:29.984575 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:29.991450 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:29.991929 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:29.992354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:29.993035 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:29.993482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:29.993897 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:30.126661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:30.135096 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5c6dfbab-1c93-429f-a59a-593b95b0a98a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.154959 Sep 22 15:08:30.135664 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 510/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:29 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:31.158136 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:31.158772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:31.165170 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:31.165651 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:31.166094 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:31.166809 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:31.167268 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:31.167695 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:31.296900 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:31.305080 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c7847fd2-603b-4562-9850-ac0bd072ee53 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.150744 Sep 22 15:08:31.305601 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 524/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:31 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:32.328757 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:32.329379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:32.336613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:32.337105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:32.337545 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:32.338245 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:32.338999 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:32.339428 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:32.476131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:32.484125 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-3bfb72c1-0ffd-49b9-84b4-460b235bc0b7 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.159294 Sep 22 15:08:32.484690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 511/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:32 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:33.507541 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:33.508154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:33.514526 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:33.515029 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:33.515477 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:33.516164 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:33.516616 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:33.517045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:33.645497 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:33.653251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-515d855e-f68c-4d71-a41a-2cb4b80498c4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.149616 Sep 22 15:08:33.653816 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 525/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:33 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:34.676364 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:34.677449 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:34.684106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:34.684588 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:34.685011 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:34.685730 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:34.686182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:34.686601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:34.821320 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:34.829091 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9ac6aea5-6d67-4ebf-8055-9d1b12b94717 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.156744 Sep 22 15:08:34.829656 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 512/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:34 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:35.853517 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:35.854243 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:35.863221 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:35.863699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:35.864150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:35.864984 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:35.865436 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:35.866198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:35.998642 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:36.007428 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-dd50a307-3d53-412e-ac94-c72ac4cee0b3 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.158728 Sep 22 15:08:36.008050 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 526/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:35 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:37.029838 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:37.030566 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:37.038462 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:37.039126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:37.039674 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:37.040566 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:37.041196 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:37.041859 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:37.178081 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:37.186107 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6ac64301-c195-44a3-95a7-f45740b7a1fa tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.160137 Sep 22 15:08:37.186677 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 513/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:37 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:38.209543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:38.210190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:38.216957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:38.217437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:38.217879 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:38.218572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:38.219066 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:38.219495 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:38.358116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:38.365814 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ead37524-3ec7-42f0-828f-84fdb24a1eca tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1509 microversion: 2.1 time: 0.160673 Sep 22 15:08:38.366370 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 527/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:38 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:38.387905 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:08:38.388506 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:38.395055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:38.395533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:38.396831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:38.397521 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:38.397973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:38.398393 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:38.483361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120695) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 15:08:38.549894 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [23b925f4-5c12-4a43-9b93-a701aab4fec2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 15:08:39.557035 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [23b925f4-5c12-4a43-9b93-a701aab4fec2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53748. Sep 22 15:08:39.560573 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fe239cfc-f450-4cc8-b508-54819e5a6009 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "POST /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b/action" status: 202 len: 0 microversion: 2.1 time: 1.176636 Sep 22 15:08:39.561182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 514/1041] 10.222.0.26 () {60 vars in 1278 bytes} [Thu Sep 22 15:08:38 2022] POST /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b/action => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 15:08:39.569404 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:39.570048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:39.576464 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:39.576947 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:39.577380 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:39.578133 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:39.578527 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:39.578976 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:39.722779 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:39.731114 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-65358d0c-f83b-4309-87d7-ed5ff06cd1a4 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1517 microversion: 2.1 time: 0.165662 Sep 22 15:08:39.731678 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 528/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:39 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:40.754965 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:40.756397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:40.762893 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:40.763375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:40.763835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:40.764528 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:40.765001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:40.765421 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:40.896010 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:40.903869 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-db57afe2-7ae1-4cb2-9514-e7d7e0278d00 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1519 microversion: 2.1 time: 0.153258 Sep 22 15:08:40.904434 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 515/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:40 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:41.494966 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-ee6aafd6-eb15-439f-9543-a0566977290c req-26ab6369-0aea-4734-8991-08291878bd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104a95d3-a8bf-4a19-b384-6e4b57df933b", "name": "network-vif-unplugged", "status": "completed", "tag": "4bd73d72-82f1-4636-bfba-3b9e6631d2dd"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:08:41.505147 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ee6aafd6-eb15-439f-9543-a0566977290c req-26ab6369-0aea-4734-8991-08291878bd91 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:41.505627 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ee6aafd6-eb15-439f-9543-a0566977290c req-26ab6369-0aea-4734-8991-08291878bd91 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:41.506083 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-ee6aafd6-eb15-439f-9543-a0566977290c req-26ab6369-0aea-4734-8991-08291878bd91 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:41.517618 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-ee6aafd6-eb15-439f-9543-a0566977290c req-26ab6369-0aea-4734-8991-08291878bd91 service nova] Creating event network-vif-unplugged:4bd73d72-82f1-4636-bfba-3b9e6631d2dd for instance 104a95d3-a8bf-4a19-b384-6e4b57df933b on hv-cinder-84456 Sep 22 15:08:41.523161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-ee6aafd6-eb15-439f-9543-a0566977290c req-26ab6369-0aea-4734-8991-08291878bd91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031963 Sep 22 15:08:41.523968 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 529/1044] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:08:41.928501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:41.929119 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:41.936761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:41.937249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:41.937677 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:41.938379 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:41.938854 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:41.939274 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:42.075747 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:42.083503 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-6cb3fe63-79bc-4315-b480-3c8a0fdd645c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.159530 Sep 22 15:08:42.084175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 516/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:41 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:43.107905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:43.108607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:43.114881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:43.115365 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:43.115802 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:43.116489 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:43.116940 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:43.117361 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:43.246167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:43.253841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5fdb06d8-99a7-462a-a02b-5c148921d105 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.150651 Sep 22 15:08:43.254403 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 530/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:43 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:44.277788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:44.278405 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:44.284919 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:44.285397 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:44.285833 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:44.287193 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:44.287653 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:44.288080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:44.419784 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:44.427407 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b70ac6c4-a7e8-4cf5-86c7-d4049069980a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.153489 Sep 22 15:08:44.427970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 517/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:44 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:08:45.450429 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:45.451068 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:45.457492 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:45.457973 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:45.458439 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:45.459158 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:45.459610 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:45.460036 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:45.588775 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:45.596878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-850ea41f-9834-40a9-a159-c33813de47bb tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.150322 Sep 22 15:08:45.597466 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 531/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:45 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:46.620882 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:46.621499 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:46.628042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:46.628527 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:46.628969 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:46.629663 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:46.630889 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:46.631322 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:46.764721 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:46.772487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d394cb43-5350-49b6-8438-3e40a204ea1a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.155489 Sep 22 15:08:46.773049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 518/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:46 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:47.796089 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:47.796701 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:47.803932 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:47.804446 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:47.804887 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:47.805589 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:47.806046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:47.806473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:47.937201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:47.944975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-0e6b3424-d438-4ed7-8936-53ba2968c335 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.152790 Sep 22 15:08:47.945531 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 532/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:47 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:48.968771 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:48.969378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:48.975900 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:48.976373 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:48.976802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:48.977487 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:48.977934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:48.978354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:49.108967 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:49.117615 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a2badfe0-e22e-4e05-84e7-5f9d39e98276 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.152886 Sep 22 15:08:49.118182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 519/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:48 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:08:50.140494 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:50.141109 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:50.148394 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:50.148879 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:50.149315 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:50.150038 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:50.150495 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:50.151242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:50.283413 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:50.291193 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9c30873c-962b-49e5-bca1-9f3c0a10b1a5 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.154578 Sep 22 15:08:50.291754 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 533/1052] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:50 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:51.315258 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:51.315878 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:51.322895 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:51.323388 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:51.323825 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:51.324526 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:51.324982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:51.325408 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:51.466631 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:51.475040 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1e8bf3a5-064f-49cf-b0a6-e9bc6878864c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.164063 Sep 22 15:08:51.475624 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 520/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:51 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:51.578272 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-45e0be86-a564-4345-b3aa-8e8511c1cfee req-eac79eae-3445-4543-b957-d7771a88ee02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104a95d3-a8bf-4a19-b384-6e4b57df933b", "name": "network-vif-plugged", "status": "completed", "tag": "4bd73d72-82f1-4636-bfba-3b9e6631d2dd"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:08:51.589870 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-45e0be86-a564-4345-b3aa-8e8511c1cfee req-eac79eae-3445-4543-b957-d7771a88ee02 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:51.590356 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-45e0be86-a564-4345-b3aa-8e8511c1cfee req-eac79eae-3445-4543-b957-d7771a88ee02 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:51.590836 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-45e0be86-a564-4345-b3aa-8e8511c1cfee req-eac79eae-3445-4543-b957-d7771a88ee02 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:51.602741 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-45e0be86-a564-4345-b3aa-8e8511c1cfee req-eac79eae-3445-4543-b957-d7771a88ee02 service nova] Creating event network-vif-plugged:4bd73d72-82f1-4636-bfba-3b9e6631d2dd for instance 104a95d3-a8bf-4a19-b384-6e4b57df933b on hv-cinder-84456 Sep 22 15:08:51.608264 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-45e0be86-a564-4345-b3aa-8e8511c1cfee req-eac79eae-3445-4543-b957-d7771a88ee02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Sep 22 15:08:51.608961 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 534/1054] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:08:52.497915 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:52.498557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:52.504999 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:52.505482 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:52.505910 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:52.506592 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:52.507063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:52.507474 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:52.638545 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:52.646871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-90a3af6d-bf61-4e0b-b331-8ff0f39bbd3f tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1575 microversion: 2.1 time: 0.152789 Sep 22 15:08:52.647441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 521/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:52 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:08:53.672296 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:08:53.673004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:08:53.679913 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:53.680396 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:53.680837 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:53.681570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:08:53.682024 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:08:53.682450 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:08:53.812956 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:08:53.820676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c7b827af-2f49-4e6c-939c-129d6df5505a tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1562 microversion: 2.1 time: 0.153513 Sep 22 15:08:53.821237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 535/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:08:53 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:06.783316 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 22 15:10:06.784116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 15:10:06.784116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Thu Sep 22 15:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 22 15:10:06.784580 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Thu Sep 22 15:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b (ip 10.222.0.26) !!! Sep 22 15:10:06.786326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 15:10:06.786326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Thu Sep 22 15:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 22 15:10:06.787671 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:06.789135 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=30 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:06.789309 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:06.793032 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:06.797021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:06.797931 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:06.816033 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:06.816713 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:06.817225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:06.818040 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:06.819401 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:06.819985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:06.852033 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:10:06.883710 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-bc597fea-2f81-4f00-b4fe-d2429b454614 req-349bc80d-6342-4f94-bf98-67a75f641372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104a95d3-a8bf-4a19-b384-6e4b57df933b", "tag": "4bd73d72-82f1-4636-bfba-3b9e6631d2dd"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:10:06.894470 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-bc597fea-2f81-4f00-b4fe-d2429b454614 req-349bc80d-6342-4f94-bf98-67a75f641372 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:06.895009 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-bc597fea-2f81-4f00-b4fe-d2429b454614 req-349bc80d-6342-4f94-bf98-67a75f641372 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:06.895551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-bc597fea-2f81-4f00-b4fe-d2429b454614 req-349bc80d-6342-4f94-bf98-67a75f641372 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:06.913161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-bc597fea-2f81-4f00-b4fe-d2429b454614 req-349bc80d-6342-4f94-bf98-67a75f641372 service nova] Creating event network-changed:4bd73d72-82f1-4636-bfba-3b9e6631d2dd for instance 104a95d3-a8bf-4a19-b384-6e4b57df933b on hv-cinder-84456 Sep 22 15:10:06.919326 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-bc597fea-2f81-4f00-b4fe-d2429b454614 req-349bc80d-6342-4f94-bf98-67a75f641372 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137080 Sep 22 15:10:06.920368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 536/1057] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:10:06.948844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-1ea34bac-b10a-42c6-9714-ac4df43dc773 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "DELETE /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 204 len: 0 microversion: 2.1 time: 0.168062 Sep 22 15:10:06.949763 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 522/1058] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:10:06 2022] DELETE /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:10:06.960796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:06.961930 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:06.970064 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:06.970669 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:06.971188 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:06.971962 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:06.972481 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:06.972967 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:07.113285 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:07.121154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-14a10446-65b1-414d-b936-7d4b8a2c492c tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.166538 Sep 22 15:10:07.126379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 537/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:06 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:08.145619 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:08.147134 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:08.153761 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:08.154247 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:08.154690 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:08.155421 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:08.155877 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:08.156302 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:08.287964 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:08.295794 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7916078d-850b-4228-b9d7-004e7efb43b9 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1568 microversion: 2.1 time: 0.154443 Sep 22 15:10:08.296570 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 523/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:08 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:09.063576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-5ba5fc40-a494-44ee-8047-b896446baf37 req-9ed304be-de67-454c-b761-42099cca8c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104a95d3-a8bf-4a19-b384-6e4b57df933b", "name": "network-vif-deleted", "tag": "4bd73d72-82f1-4636-bfba-3b9e6631d2dd"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:10:09.075045 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-5ba5fc40-a494-44ee-8047-b896446baf37 req-9ed304be-de67-454c-b761-42099cca8c42 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:09.075534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-5ba5fc40-a494-44ee-8047-b896446baf37 req-9ed304be-de67-454c-b761-42099cca8c42 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:09.075964 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-5ba5fc40-a494-44ee-8047-b896446baf37 req-9ed304be-de67-454c-b761-42099cca8c42 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:09.087620 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-5ba5fc40-a494-44ee-8047-b896446baf37 req-9ed304be-de67-454c-b761-42099cca8c42 service nova] Creating event network-vif-deleted:4bd73d72-82f1-4636-bfba-3b9e6631d2dd for instance 104a95d3-a8bf-4a19-b384-6e4b57df933b on hv-cinder-84456 Sep 22 15:10:09.092799 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-5ba5fc40-a494-44ee-8047-b896446baf37 req-9ed304be-de67-454c-b761-42099cca8c42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032664 Sep 22 15:10:09.093403 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 538/1061] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:10:09.319465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:09.320198 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:09.326975 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:09.327470 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:09.327904 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:09.329105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:09.329105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:09.329604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:09.398943 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b761e143a6264e66aac0caac8cb46135', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6ca70d427646d3b0a8ebd2838c807b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:09.407288 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-cc145b1a-198d-4ee7-9646-77254f7b2df6 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 200 len: 1220 microversion: 2.1 time: 0.091725 Sep 22 15:10:09.407957 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 524/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:09 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:10.432515 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:10.433201 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] [instance: 104a95d3-a8bf-4a19-b384-6e4b57df933b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:10.439258 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:10.439730 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:10.440156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:10.440840 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:10.441283 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:10.441694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:10.454491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] HTTP exception thrown: Instance 104a95d3-a8bf-4a19-b384-6e4b57df933b could not be found. Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Request method failure captured: Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b HTTP/1.1 Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHm8LKVnPBBvdOJ_6lUpMvb354ewqOujKiBdy1ewVwYDn0WqO2AVUY9v3Q52RTrkVVyQPwx-AAYSpsejvRI4rmyKMWf1ppsRLnfhwhSZCHdzA3VkLHTu8RSjnfpFooCfYpNw-tyJXCcVXX7B8dq_Zouw-C7cAZGHzXrhI6Tvo5N7Hs8 Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: ab6ca70d427646d3b0a8ebd2838c807b Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-TestShelveInstance-1215936921 Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:10:10.456121 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab6ca70d427646d3b0a8ebd2838c807b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab6ca70d427646d3b0a8ebd2838c807b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab6ca70d427646d3b0a8ebd2838c807b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab6ca70d427646d3b0a8ebd2838c807b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-TestShelveInstance-1215936921 Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: ab6ca70d427646d3b0a8ebd2838c807b Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-TestShelveInstance-1215936921 Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-TestShelveInstance-1215936921-project Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: b761e143a6264e66aac0caac8cb46135 Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-TestShelveInstance-1215936921-project Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 104a95d3-a8bf-4a19-b384-6e4b57df933b could not be found. Sep 22 15:10:10.457874 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '104a95d3-a8bf-4a19-b384-6e4b57df933b'} Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104a95d3-a8bf-4a19-b384-6e4b57df933b could not be found. Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:10:10.459604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104a95d3-a8bf-4a19-b384-6e4b57df933b could not be found. Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104a95d3-a8bf-4a19-b384-6e4b57df933b could not be found. Sep 22 15:10:10.461225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:10:10.462905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Returning 404 to user: Instance 104a95d3-a8bf-4a19-b384-6e4b57df933b could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:10:10.462905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-4b35993f-de90-4a6d-9106-64ede66370ea tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b" status: 404 len: 111 microversion: 2.1 time: 0.030394 Sep 22 15:10:10.462905 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 539/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:10 2022] GET /compute/v2.1/servers/104a95d3-a8bf-4a19-b384-6e4b57df933b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 15:10:10.623102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-688ac949-afcb-4673-978a-17cf3309f323 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] Calling method '.version_select at 0x7f77e641e550>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:10.642120 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-688ac949-afcb-4673-978a-17cf3309f323 tempest-TestShelveInstance-1215936921 tempest-TestShelveInstance-1215936921-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1833378044" status: 202 len: 0 microversion: 2.1 time: 0.022767 Sep 22 15:10:10.642710 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 525/1064] 10.222.0.26 () {58 vars in 1254 bytes} [Thu Sep 22 15:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1833378044 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 15:10:28.221714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=8 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:28.233622 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=12 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:28.445892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-967e6bb3-9982-455e-b246-ada6b85e2c96 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Action: 'create', calling method: .version_select at 0x7f77e63523a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1004651777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiMpWBv6BE/OAcqEkuATzK5oShpIdfOTQhWkRdO2gBbrelNLy2+ip0f3WE1mH0LWogoobOwoT6+oDfJxPoOqTrEeC2YcjQUl9Zu352zbx/lMFD/QRc86TJlGv6K0ZijNA=="}} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:10:28.465240 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-967e6bb3-9982-455e-b246-ada6b85e2c96 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for project 1b64f192d3ea436abc310162b1c46efc. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:10:28.469640 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.quota [None req-967e6bb3-9982-455e-b246-ada6b85e2c96 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for user 8d49d3422c7d420db80fe5814a768f53 and project 1b64f192d3ea436abc310162b1c46efc. Resources: {'key_pairs'} {{(pid=120694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:10:28.503047 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-967e6bb3-9982-455e-b246-ada6b85e2c96 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.286616 Sep 22 15:10:28.503693 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 540/1065] 10.222.0.26 () {60 vars in 1159 bytes} [Thu Sep 22 15:10:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:10:43.766647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:43.767456 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:43.771586 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1361075333", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1004651777", "security_groups": [{"name": "tempest-secgroup-smoke-134926766"}], "block_device_mapping_v2": [{"uuid": "f9224530-90b2-4882-be81-0b3341d58a20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac0c2505-e498-4e33-b6c0-96b0f3302e4b"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:10:43.891661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] validate_networks() for [('ac0c2505-e498-4e33-b6c0-96b0f3302e4b', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:10:44.263144 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:10:44.263565 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:10:44.264035 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:10:44.264441 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:10:44.264855 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:10:44.273996 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:44.274473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:44.274945 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:44.275662 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:44.276112 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:44.276533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:44.293327 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for project 1b64f192d3ea436abc310162b1c46efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:10:44.297269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for user 8d49d3422c7d420db80fe5814a768f53 and project 1b64f192d3ea436abc310162b1c46efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:10:44.354021 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:10:44.356178 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9224530-90b2-4882-be81-0b3341d58a20',volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:10:44.485417 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f5aaff24-b2ac-4ef8-8204-d1418386371f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720024 Sep 22 15:10:44.486066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 526/1066] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:10:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:10:44.497176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8db865ed-c615-42c2-aa4f-8f5e837e86e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:44.497780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8db865ed-c615-42c2-aa4f-8f5e837e86e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:44.500560 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=4 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:44.501486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:44.561812 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8db865ed-c615-42c2-aa4f-8f5e837e86e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:44.569359 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8db865ed-c615-42c2-aa4f-8f5e837e86e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1095 microversion: 2.1 time: 0.076040 Sep 22 15:10:44.570195 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 541/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:44 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:45.592860 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:45.593832 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:45.600552 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:45.601338 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:45.601593 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:45.602501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:45.602882 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:45.603318 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:45.671196 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:45.679484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d11b108c-4745-4ae1-aa57-1a9bb3c3eac7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1211 microversion: 2.1 time: 0.091114 Sep 22 15:10:45.680241 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 527/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:45 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:46.701841 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:46.702580 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:46.709225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:46.709719 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:46.710156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:46.710968 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:46.711426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:46.711849 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:46.842469 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:46.851048 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3de02313-6727-4514-8364-a61e1db9efa1 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.153293 Sep 22 15:10:46.852244 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 542/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:46 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:46.905249 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-3c03ff3e-5e37-4089-8061-bdb95510db18 req-f2759235-a393-4b26-8dfa-72c6844f4d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6430ac-d145-4dc0-b048-ded1ea71ee5a", "tag": "262a197d-1f4f-4189-b4b4-f59ef871e587"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:10:46.920601 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-3c03ff3e-5e37-4089-8061-bdb95510db18 req-f2759235-a393-4b26-8dfa-72c6844f4d21 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:46.921238 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-3c03ff3e-5e37-4089-8061-bdb95510db18 req-f2759235-a393-4b26-8dfa-72c6844f4d21 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:46.932677 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-3c03ff3e-5e37-4089-8061-bdb95510db18 req-f2759235-a393-4b26-8dfa-72c6844f4d21 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:46.947588 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-3c03ff3e-5e37-4089-8061-bdb95510db18 req-f2759235-a393-4b26-8dfa-72c6844f4d21 service nova] Creating event network-changed:262a197d-1f4f-4189-b4b4-f59ef871e587 for instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a on hv-cinder-84456 Sep 22 15:10:46.952581 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-3c03ff3e-5e37-4089-8061-bdb95510db18 req-f2759235-a393-4b26-8dfa-72c6844f4d21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051390 Sep 22 15:10:46.953182 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 528/1070] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:10:47.874966 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:47.875765 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:47.883424 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:47.883926 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:47.884368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:47.885077 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:47.885537 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:47.885971 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:48.019319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:48.027128 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-a857b4bc-383e-4755-a1f9-fad76ff7b17c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.156059 Sep 22 15:10:48.027692 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 543/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:47 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:49.050294 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:49.050955 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:49.059147 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:49.059641 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:49.060079 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:49.060958 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:49.061420 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:49.061850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:49.213332 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:49.221451 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-219b325f-365f-443e-869c-f4fa3b18f79a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.176029 Sep 22 15:10:49.222018 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 529/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:49 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:50.245084 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:50.245682 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:50.252128 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:50.252608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:50.253042 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:50.253733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:50.254185 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:50.254607 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:50.386602 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:50.394249 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-1dc8323b-37c4-47cd-8798-fdb7b74c3fc7 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.153027 Sep 22 15:10:50.394818 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 544/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:50 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:51.416489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:51.417099 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:51.423556 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:51.424037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:51.424473 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:51.425172 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:51.425623 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:51.426045 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:51.557497 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:51.565173 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-376097a5-c3e0-4539-8816-7d6eab99812b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.152572 Sep 22 15:10:51.565734 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 530/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:51 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:52.588911 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:52.589463 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:52.596302 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:52.596781 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:52.597210 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:52.597894 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:52.598337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:52.598779 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:52.727107 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:52.734708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5cf482e6-93ca-4e47-88fb-6f7bb381749d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.149712 Sep 22 15:10:52.735291 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 545/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:52 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:53.757238 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:53.757844 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:53.764323 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:53.764801 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:53.765233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:53.765909 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:53.766354 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:53.766791 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:53.896730 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:53.904319 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-8500c6a0-d9b5-4cb3-be2c-3f06cfdc0567 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.150933 Sep 22 15:10:53.904881 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 531/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:53 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:54.928386 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:54.929002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:54.931382 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:54.936756 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:54.937242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:54.937679 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:54.938383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:54.938898 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:54.939337 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:55.075027 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:55.082608 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e2492d93-09de-45f4-b96d-0921472553dc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.158954 Sep 22 15:10:55.083198 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 546/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:54 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:56.106452 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:56.107637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:56.109665 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:56.110343 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:10:56.117742 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:56.118231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:56.118667 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:56.119406 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:56.121272 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:56.121707 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:56.267889 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:56.283852 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b6d92168-078f-4d92-b138-149f7570196a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.182029 Sep 22 15:10:56.298951 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 532/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:56 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:56.341300 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-25a705d8-c877-45c8-a589-443217a02594 req-b28d4c85-3454-45be-8174-f5b5ef99ce85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6430ac-d145-4dc0-b048-ded1ea71ee5a", "name": "network-vif-plugged", "status": "completed", "tag": "262a197d-1f4f-4189-b4b4-f59ef871e587"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:10:56.351157 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-25a705d8-c877-45c8-a589-443217a02594 req-b28d4c85-3454-45be-8174-f5b5ef99ce85 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:56.351644 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-25a705d8-c877-45c8-a589-443217a02594 req-b28d4c85-3454-45be-8174-f5b5ef99ce85 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:56.352079 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-25a705d8-c877-45c8-a589-443217a02594 req-b28d4c85-3454-45be-8174-f5b5ef99ce85 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:56.362943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-25a705d8-c877-45c8-a589-443217a02594 req-b28d4c85-3454-45be-8174-f5b5ef99ce85 service nova] Creating event network-vif-plugged:262a197d-1f4f-4189-b4b4-f59ef871e587 for instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a on hv-cinder-84456 Sep 22 15:10:56.368443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-25a705d8-c877-45c8-a589-443217a02594 req-b28d4c85-3454-45be-8174-f5b5ef99ce85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090211 Sep 22 15:10:56.369093 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 547/1079] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:10:57.307368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:57.307980 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:57.314376 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:57.314897 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:57.315330 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:57.316019 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:57.316466 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:57.316887 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:57.448722 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:57.456808 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f012bbd6-c825-4f19-8a02-c39fa4d1216b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1266 microversion: 2.1 time: 0.153381 Sep 22 15:10:57.457378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 533/1080] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:57 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:58.481698 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:58.482388 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:58.488473 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:58.488943 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:58.489378 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:58.490090 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:58.490537 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:58.490980 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:58.630434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:58.638161 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-85adfa6e-4ab0-4579-b1e6-dc0ea1e119af tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1453 microversion: 2.1 time: 0.161132 Sep 22 15:10:58.638725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 548/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:58 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:10:58.660584 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:10:58.661208 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:10:58.668252 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:58.668742 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:58.669183 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:58.669880 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:10:58.670338 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:10:58.670787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:10:58.801737 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:10:58.809554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-7494915a-beab-45e4-a836-2dae37644731 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1453 microversion: 2.1 time: 0.153086 Sep 22 15:10:58.810124 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 534/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:10:58 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:11:00.525664 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-6a0316b3-9468-4c58-af1a-a28d8bb14da1 req-10e6c1b4-ecc7-4511-a856-d8ff0e095f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6430ac-d145-4dc0-b048-ded1ea71ee5a", "tag": "262a197d-1f4f-4189-b4b4-f59ef871e587"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:11:00.535495 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-6a0316b3-9468-4c58-af1a-a28d8bb14da1 req-10e6c1b4-ecc7-4511-a856-d8ff0e095f78 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:11:00.536067 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-6a0316b3-9468-4c58-af1a-a28d8bb14da1 req-10e6c1b4-ecc7-4511-a856-d8ff0e095f78 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:11:00.536576 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-6a0316b3-9468-4c58-af1a-a28d8bb14da1 req-10e6c1b4-ecc7-4511-a856-d8ff0e095f78 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:11:00.548062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-6a0316b3-9468-4c58-af1a-a28d8bb14da1 req-10e6c1b4-ecc7-4511-a856-d8ff0e095f78 service nova] Creating event network-changed:262a197d-1f4f-4189-b4b4-f59ef871e587 for instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a on hv-cinder-84456 Sep 22 15:11:00.553725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-6a0316b3-9468-4c58-af1a-a28d8bb14da1 req-10e6c1b4-ecc7-4511-a856-d8ff0e095f78 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085670 Sep 22 15:11:00.554434 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 549/1083] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:12:55.763040 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR oslo.messaging._drivers.impl_rabbit [-] [045eb04a-7028-4007-913c-5a422ed19905] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 15:12:55.763777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:12:55.764516 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=46 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:12:55.766006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 22 15:12:55.766006 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Thu Sep 22 15:12:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a (ip 10.222.0.26) !!! Sep 22 15:12:55.770827 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:12:55.771334 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:12:55.781104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:55.781588 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:55.782048 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:55.782757 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:55.783230 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:55.783661 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:55.808903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:12:55.884600 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-885bd252-97e1-4778-9b99-454b25990045 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 204 len: 0 microversion: 2.1 time: 0.123688 Sep 22 15:12:55.885202 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 535/1084] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:12:55 2022] DELETE /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:12:55.895533 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:12:55.896236 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:12:55.898885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ddba300d-7827-426a-8eb8-b8b8df5d2dd9] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 15:12:55.899407 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=20 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:12:55.900115 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=40 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:12:55.908065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:55.908551 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:55.909000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:55.909702 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:55.910167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:55.910596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:56.045319 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:12:56.053338 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-44fd5cd9-e5ca-4a69-9f40-adb6927f01e5 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1577 microversion: 2.1 time: 0.163123 Sep 22 15:12:56.053898 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 550/1085] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:12:55 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:12:57.078622 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:12:57.079603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:12:57.087220 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:57.087697 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:57.088126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:57.088834 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:57.089361 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:57.089803 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:57.106693 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [-] [045eb04a-7028-4007-913c-5a422ed19905] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 54170. Sep 22 15:12:57.228433 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:12:57.236604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-901f2dbc-fffe-4bf8-979d-9a66afaf135c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1577 microversion: 2.1 time: 0.162257 Sep 22 15:12:57.237174 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 536/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:12:57 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:12:58.260030 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:12:58.261167 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:12:58.268427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:58.268935 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:58.269379 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:58.270098 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:58.270584 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:58.271218 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:58.278600 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO oslo.messaging._drivers.impl_rabbit [-] [ddba300d-7827-426a-8eb8-b8b8df5d2dd9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 54174. Sep 22 15:12:58.340714 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:12:58.349018 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c90c7e80-c6e3-4c76-8dbf-4fd3dea722e3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 200 len: 1510 microversion: 2.1 time: 0.092821 Sep 22 15:12:58.349815 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 551/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:12:58 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:12:58.497043 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-8eff11b3-3b01-453e-ba5e-17c642a4db90 req-093fdc00-7ca0-4b30-a425-b9a1293effa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6430ac-d145-4dc0-b048-ded1ea71ee5a", "name": "network-vif-deleted", "tag": "262a197d-1f4f-4189-b4b4-f59ef871e587"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:12:58.515084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8eff11b3-3b01-453e-ba5e-17c642a4db90 req-093fdc00-7ca0-4b30-a425-b9a1293effa7 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:58.516137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8eff11b3-3b01-453e-ba5e-17c642a4db90 req-093fdc00-7ca0-4b30-a425-b9a1293effa7 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:58.516858 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-8eff11b3-3b01-453e-ba5e-17c642a4db90 req-093fdc00-7ca0-4b30-a425-b9a1293effa7 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:58.529960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-8eff11b3-3b01-453e-ba5e-17c642a4db90 req-093fdc00-7ca0-4b30-a425-b9a1293effa7 service nova] Creating event network-vif-deleted:262a197d-1f4f-4189-b4b4-f59ef871e587 for instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a on hv-cinder-84456 Sep 22 15:12:58.535367 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-8eff11b3-3b01-453e-ba5e-17c642a4db90 req-093fdc00-7ca0-4b30-a425-b9a1293effa7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042455 Sep 22 15:12:58.536932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 537/1088] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:12:59.373111 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:12:59.373825 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:12:59.380529 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:59.381116 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:59.381653 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:59.382451 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:59.383014 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:59.383523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:59.400438 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] HTTP exception thrown: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Request method failure captured: Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a HTTP/1.1 Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHreeYltevYsHS4eVfp2pDKc9_Dq1kI5pVYkq7IJ5vpgG1l8sHkjBxC9ppmTkn3bkSqyRhbjbriRxnO_JVE5ha1nNaCoCbL6PZuk7scjrOrbAnaQ49WG0nG3mB0n-ADPeD7oyYSqj9aNaGF6bjH9W5kipZkqlbE9mmzzssHpbOjAxAg Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:12:59.402772 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-TestVolumeBootPattern-742437028 Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 8d49d3422c7d420db80fe5814a768f53 Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:12:59.404615 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '5c6430ac-d145-4dc0-b048-ded1ea71ee5a'} Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:12:59.405699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:12:59.408187 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:12:59.410697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Returning 404 to user: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:12:59.410697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-9e0b9313-a939-4a38-8815-7d66f91eaf7b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 404 len: 111 microversion: 2.1 time: 0.036566 Sep 22 15:12:59.410697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 552/1089] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:12:59 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:12:59.456479 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-448687500", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1004651777", "security_groups": [{"name": "tempest-secgroup-smoke-134926766"}], "block_device_mapping_v2": [{"uuid": "f9224530-90b2-4882-be81-0b3341d58a20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac0c2505-e498-4e33-b6c0-96b0f3302e4b"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:12:59.576356 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] validate_networks() for [('ac0c2505-e498-4e33-b6c0-96b0f3302e4b', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:12:59.944973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:12:59.945396 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:12:59.945872 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:12:59.946283 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:12:59.946695 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:12:59.956066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:59.956552 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:59.956991 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:59.957759 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:12:59.958224 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:12:59.958650 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:12:59.975246 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for project 1b64f192d3ea436abc310162b1c46efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:12:59.979230 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for user 8d49d3422c7d420db80fe5814a768f53 and project 1b64f192d3ea436abc310162b1c46efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:13:00.037199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:13:00.039772 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9224530-90b2-4882-be81-0b3341d58a20',volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:13:00.172437 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-62823550-4132-4cf4-8c95-1cddd8ece28f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720344 Sep 22 15:13:00.173091 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 538/1090] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:12:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:13:00.184824 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ba72ebb5-0add-4a41-8015-d3f353a7b631 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:00.185535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ba72ebb5-0add-4a41-8015-d3f353a7b631 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:00.238408 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ba72ebb5-0add-4a41-8015-d3f353a7b631 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:00.245877 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ba72ebb5-0add-4a41-8015-d3f353a7b631 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1094 microversion: 2.1 time: 0.065068 Sep 22 15:13:00.246782 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 553/1091] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:00 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:01.268988 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:01.269871 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:01.277468 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:01.278075 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:01.278622 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:01.279432 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:01.280072 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:01.280595 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:01.349785 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:01.358159 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-286f2cc9-84a1-4fc7-a8c3-c924007f84d9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1210 microversion: 2.1 time: 0.093214 Sep 22 15:13:01.358753 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 539/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:01 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:02.381145 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:02.381793 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:02.389699 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:02.390188 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:02.390636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:02.391387 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:02.391848 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:02.392284 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:02.531245 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:02.540513 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-fcff28b3-5385-4bda-9e9d-1e1b476b9126 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.162894 Sep 22 15:13:02.541316 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 554/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:02 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:02.547109 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-def15fcf-69f3-4929-bf82-0161dc77c430 req-c2fc0c3d-ca5b-42f9-b818-35b29317f75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833c7d9c-75a6-4497-89e4-b6806558c3df", "tag": "91c5dd67-fcfe-416a-a91c-9493e83d8cb7"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:13:02.559719 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-def15fcf-69f3-4929-bf82-0161dc77c430 req-c2fc0c3d-ca5b-42f9-b818-35b29317f75d service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:02.560522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-def15fcf-69f3-4929-bf82-0161dc77c430 req-c2fc0c3d-ca5b-42f9-b818-35b29317f75d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:02.561264 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-def15fcf-69f3-4929-bf82-0161dc77c430 req-c2fc0c3d-ca5b-42f9-b818-35b29317f75d service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:02.576127 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-def15fcf-69f3-4929-bf82-0161dc77c430 req-c2fc0c3d-ca5b-42f9-b818-35b29317f75d service nova] Creating event network-changed:91c5dd67-fcfe-416a-a91c-9493e83d8cb7 for instance 833c7d9c-75a6-4497-89e4-b6806558c3df on hv-cinder-84456 Sep 22 15:13:02.581685 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-def15fcf-69f3-4929-bf82-0161dc77c430 req-c2fc0c3d-ca5b-42f9-b818-35b29317f75d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039962 Sep 22 15:13:02.582500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 540/1094] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:13:03.566570 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:03.567213 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:03.573543 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:03.574171 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:03.575150 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:03.575844 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:03.576293 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:03.576712 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:03.712294 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:03.720063 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e69c4ce8-27a9-412b-ac59-5c2e5bd18a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.157312 Sep 22 15:13:03.720625 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 555/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:03 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:04.743696 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:04.744310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:04.750440 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:04.750960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:04.751400 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:04.752096 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:04.752554 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:04.752981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:04.890967 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:04.898952 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-635c8749-01fc-462f-827d-c0659c089781 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.160003 Sep 22 15:13:04.899549 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 541/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:04 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:05.922948 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:05.923597 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:05.930043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:05.930528 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:05.930999 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:05.931697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:05.932154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:05.932590 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:06.065903 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:06.073544 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-ea591951-004b-4dd5-92ab-bde33f85b422 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.154559 Sep 22 15:13:06.074102 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 556/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:05 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:07.095765 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:07.096363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:07.103122 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:07.103606 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:07.104044 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:07.104739 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:07.105194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:07.106101 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:07.236778 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:07.244411 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-d7d918ef-66c6-40fb-b547-10e3b7cc71e0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.152579 Sep 22 15:13:07.244982 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 542/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:07 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:08.267907 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:08.268577 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:08.274963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:08.275443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:08.275878 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:08.276578 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:08.277056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:08.277516 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:08.411155 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:08.419498 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e07711f7-66e6-4e88-8bcf-45a249f4bfbf tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.155454 Sep 22 15:13:08.420069 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 557/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:08 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:09.441788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:09.442404 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:09.449512 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:09.450042 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:09.450512 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:09.451231 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:09.451707 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:09.452126 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:09.581016 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:09.588619 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-b23d4736-ffd8-48e7-87b9-69ebf6d7c7d8 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.150764 Sep 22 15:13:09.589211 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 543/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:09 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:10.612227 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:10.612842 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:10.615153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:13:10.620533 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:10.621015 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:10.621457 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:10.622149 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:10.622604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:10.623107 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:10.751078 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:10.758751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-56b61a2d-00ab-497f-a338-9858bc1b73ed tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.150382 Sep 22 15:13:10.759323 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 558/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:10 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:11.781961 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:11.782614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:11.784519 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:13:11.785169 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:13:11.791150 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:11.791630 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:11.792104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:11.793368 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:11.793807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:11.794225 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:11.929078 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:11.936835 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4a91440b-25c2-4892-ba42-bb063c51a146 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.158687 Sep 22 15:13:11.937400 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 544/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:11 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:12.960000 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:12.960916 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:12.966594 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:12.967173 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:12.967596 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:12.968345 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:12.968840 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:12.969224 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:13.068349 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-0cd5b0de-1dd7-4f8d-bdfa-69c42c4573e8 req-f7890a60-bb51-487f-9636-06dea075daaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833c7d9c-75a6-4497-89e4-b6806558c3df", "name": "network-vif-plugged", "status": "completed", "tag": "91c5dd67-fcfe-416a-a91c-9493e83d8cb7"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:13:13.078489 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0cd5b0de-1dd7-4f8d-bdfa-69c42c4573e8 req-f7890a60-bb51-487f-9636-06dea075daaf service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:13.079001 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0cd5b0de-1dd7-4f8d-bdfa-69c42c4573e8 req-f7890a60-bb51-487f-9636-06dea075daaf service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:13.079436 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-0cd5b0de-1dd7-4f8d-bdfa-69c42c4573e8 req-f7890a60-bb51-487f-9636-06dea075daaf service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:13.090908 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-0cd5b0de-1dd7-4f8d-bdfa-69c42c4573e8 req-f7890a60-bb51-487f-9636-06dea075daaf service nova] Creating event network-vif-plugged:91c5dd67-fcfe-416a-a91c-9493e83d8cb7 for instance 833c7d9c-75a6-4497-89e4-b6806558c3df on hv-cinder-84456 Sep 22 15:13:13.096131 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-0cd5b0de-1dd7-4f8d-bdfa-69c42c4573e8 req-f7890a60-bb51-487f-9636-06dea075daaf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031467 Sep 22 15:13:13.097529 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 545/1103] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:13:13.105410 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:13.113725 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-52be9585-952f-4310-80d6-b65acad5721a tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.158223 Sep 22 15:13:13.114532 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 559/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:12 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:14.140777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:14.141505 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:14.147630 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:14.148102 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:14.148533 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:14.149215 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:14.149663 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:14.150080 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:14.513324 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:14.521507 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-ca924d31-b6e6-4081-be2d-dae705e65f01 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1265 microversion: 2.1 time: 0.386020 Sep 22 15:13:14.522068 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 546/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:14 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:15.544627 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:15.545245 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:15.552304 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:15.552788 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:15.553226 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:15.553921 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:15.554375 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:15.554835 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:15.681652 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:15.689538 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-8c885b72-44c4-4516-a9b8-d363bbedd44b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1452 microversion: 2.1 time: 0.148824 Sep 22 15:13:15.690107 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 560/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:15 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:15.711783 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:13:15.712416 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:13:15.719401 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:15.719886 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:15.720331 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:15.721030 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:15.721484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:15.721911 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:15.864464 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:13:15.872465 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-974ade8e-76a8-4277-9e85-51f4cba8eb7d tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1452 microversion: 2.1 time: 0.164459 Sep 22 15:13:15.873033 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 547/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:13:15 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:13:17.447801 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-3df3c1b9-0ab3-447c-b289-2a817af298e3 req-8fd1b7f3-99d0-47f8-a9f0-6a8185abd3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833c7d9c-75a6-4497-89e4-b6806558c3df", "tag": "91c5dd67-fcfe-416a-a91c-9493e83d8cb7"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:13:17.458343 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3df3c1b9-0ab3-447c-b289-2a817af298e3 req-8fd1b7f3-99d0-47f8-a9f0-6a8185abd3fd service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:13:17.458794 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3df3c1b9-0ab3-447c-b289-2a817af298e3 req-8fd1b7f3-99d0-47f8-a9f0-6a8185abd3fd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:13:17.459229 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3df3c1b9-0ab3-447c-b289-2a817af298e3 req-8fd1b7f3-99d0-47f8-a9f0-6a8185abd3fd service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:13:17.471332 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-3df3c1b9-0ab3-447c-b289-2a817af298e3 req-8fd1b7f3-99d0-47f8-a9f0-6a8185abd3fd service nova] Creating event network-changed:91c5dd67-fcfe-416a-a91c-9493e83d8cb7 for instance 833c7d9c-75a6-4497-89e4-b6806558c3df on hv-cinder-84456 Sep 22 15:13:17.477011 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-3df3c1b9-0ab3-447c-b289-2a817af298e3 req-8fd1b7f3-99d0-47f8-a9f0-6a8185abd3fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032943 Sep 22 15:13:17.477645 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 561/1108] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:14:44.393184 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:14:44.393937 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:14:44.400103 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-934262154", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1004651777", "security_groups": [{"name": "tempest-secgroup-smoke-134926766"}], "block_device_mapping_v2": [{"uuid": "f93ff617-32da-4488-8518-39939b9344fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac0c2505-e498-4e33-b6c0-96b0f3302e4b"}]}} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:14:44.610129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.network.neutron [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] validate_networks() for [('ac0c2505-e498-4e33-b6c0-96b0f3302e4b', None, None, None, None, None)] {{(pid=120695) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 15:14:45.030687 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Flavor limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 15:14:45.031132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Image limits 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 15:14:45.031604 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Flavor pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 15:14:45.032009 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Image pref 0:0:0 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 15:14:45.032418 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.virt.hardware [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 15:14:45.041160 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:45.041637 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:45.042071 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:45.042821 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:45.043328 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:45.043716 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:45.060970 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for project 1b64f192d3ea436abc310162b1c46efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 15:14:45.064981 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.quota [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Getting quotas for user 8d49d3422c7d420db80fe5814a768f53 and project 1b64f192d3ea436abc310162b1c46efc. Resources: {'instances', 'cores', 'ram'} {{(pid=120695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 15:14:45.124756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Going to run 1 instances... {{(pid=120695) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 15:14:45.127911 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f93ff617-32da-4488-8518-39939b9344fe',volume_size=None,volume_type=None)] {{(pid=120695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 15:14:45.257495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-09edc31b-6b9b-4a84-8773-06392d074639 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.866006 Sep 22 15:14:45.258501 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 548/1109] 10.222.0.26 () {60 vars in 1147 bytes} [Thu Sep 22 15:14:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 15:14:45.268162 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=26 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:14:45.268901 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=58 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:14:45.269831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 15:14:45.270225 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Thu Sep 22 15:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b (ip 10.222.0.26) !!! Sep 22 15:14:45.271380 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 15:14:45.271506 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Thu Sep 22 15:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b (ip 10.222.0.26) !!! Sep 22 15:14:45.277747 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-3ac53a6c-80da-4b4a-949e-31fea6ad0f81 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:45.278468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-3ac53a6c-80da-4b4a-949e-31fea6ad0f81 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:45.390046 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-3ac53a6c-80da-4b4a-949e-31fea6ad0f81 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:45.397314 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-3ac53a6c-80da-4b4a-949e-31fea6ad0f81 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1094 microversion: 2.1 time: 0.131394 Sep 22 15:14:45.397897 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 562/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:45 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:46.419799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:46.421105 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:46.428973 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:46.429471 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:46.430458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:46.431614 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:46.432084 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:46.432522 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:46.496012 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:46.504176 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-81bcc3c7-ab7a-45aa-ad40-0183c25ffae3 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1210 microversion: 2.1 time: 0.088281 Sep 22 15:14:46.504744 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 549/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:46 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:47.528353 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:47.528959 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:47.535785 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:47.536271 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:47.536708 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:47.537415 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:47.537867 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:47.538294 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:47.670402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:47.678299 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-b516c43a-bc12-4f64-8f8a-62e7de36c02b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.154609 Sep 22 15:14:47.678936 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 563/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:47 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:47.724704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [req-c6b5f7de-4e1d-4950-a9d7-139394db890c req-1c37b8e6-15ba-4e8e-8d70-d5c55950d206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b", "tag": "24b6e0c3-3bbc-4a74-8853-d9627d5d6286"}]} {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:14:47.740558 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c6b5f7de-4e1d-4950-a9d7-139394db890c req-1c37b8e6-15ba-4e8e-8d70-d5c55950d206 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:47.741062 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c6b5f7de-4e1d-4950-a9d7-139394db890c req-1c37b8e6-15ba-4e8e-8d70-d5c55950d206 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:47.742221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [req-c6b5f7de-4e1d-4950-a9d7-139394db890c req-1c37b8e6-15ba-4e8e-8d70-d5c55950d206 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:47.754479 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.compute.server_external_events [req-c6b5f7de-4e1d-4950-a9d7-139394db890c req-1c37b8e6-15ba-4e8e-8d70-d5c55950d206 service nova] Creating event network-changed:24b6e0c3-3bbc-4a74-8853-d9627d5d6286 for instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b on hv-cinder-84456 Sep 22 15:14:47.759683 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [req-c6b5f7de-4e1d-4950-a9d7-139394db890c req-1c37b8e6-15ba-4e8e-8d70-d5c55950d206 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040374 Sep 22 15:14:47.760603 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 550/1113] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:14:48.702128 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:48.702676 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:48.710186 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:48.711771 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:48.712445 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:48.713396 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:48.714051 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:48.714880 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:48.861535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:48.870123 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-894aa9cb-1a1d-463b-a1e0-eafe23dece5b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.172314 Sep 22 15:14:48.870836 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 564/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:48 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:49.894774 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:49.895484 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:49.902525 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:49.903048 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:49.903495 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:49.904218 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:49.904678 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:49.905104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:50.038831 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:50.047063 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c3351d93-1139-4b6b-8bad-65b005b55f6c tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.156647 Sep 22 15:14:50.047634 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 551/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:49 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:51.069523 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:51.070139 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:51.077153 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:51.077630 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:51.078056 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:51.078755 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:51.079209 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:51.079631 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:51.212279 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:51.219958 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e1247018-fbf8-4ec6-a7bc-7ca0e90d2451 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.154311 Sep 22 15:14:51.220521 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 565/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:51 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:52.243589 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:52.244154 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:52.250618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:52.251138 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:52.251578 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:52.252273 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:52.252730 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:52.253168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:52.388394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:52.396049 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-be228369-42c7-4e0d-a911-175042244442 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.156951 Sep 22 15:14:52.396609 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 552/1117] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:52 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 15:14:53.419111 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:53.419694 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:53.425575 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:53.426053 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:53.426483 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:53.427213 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:53.427670 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:53.428088 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:53.562796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:53.570951 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e130d188-30ac-41db-92cd-0646545150e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.155746 Sep 22 15:14:53.571540 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 566/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:53 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:54.593448 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:54.594026 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:54.600677 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:54.601191 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:54.602306 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:54.603066 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:54.603525 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:54.603960 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:54.737777 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:54.745615 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4fdd017e-a4dd-49d7-8bf4-0b0351bb5fab tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.156136 Sep 22 15:14:54.746178 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 553/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:54 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:55.768437 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:55.769087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:55.771504 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell0:SELECT=2 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:14:55.777395 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:55.777885 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:55.778327 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:55.779079 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:55.779535 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:55.779990 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:55.913534 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:55.921587 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-e1022d69-9242-403c-a524-f2dc2a641e3b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.157007 Sep 22 15:14:55.922156 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 567/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:55 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:56.944312 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:56.944907 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:56.947014 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=2 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:14:56.947683 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell0:SELECT=6 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:14:56.954704 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:56.955214 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:56.955655 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:56.956349 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:56.956807 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:56.957239 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:57.092204 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:57.100265 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-a398ccb6-fe70-44dc-bcf6-7df7a57b05b0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.159880 Sep 22 15:14:57.100845 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 554/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:56 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:57.655417 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-3b2546b1-4c12-4eb3-8b61-e616d47c39e5 req-cc995114-4f40-41a6-9217-308941c8f22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b", "name": "network-vif-plugged", "status": "completed", "tag": "24b6e0c3-3bbc-4a74-8853-d9627d5d6286"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:14:57.666427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3b2546b1-4c12-4eb3-8b61-e616d47c39e5 req-cc995114-4f40-41a6-9217-308941c8f22b service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:57.667383 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3b2546b1-4c12-4eb3-8b61-e616d47c39e5 req-cc995114-4f40-41a6-9217-308941c8f22b service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:57.667826 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-3b2546b1-4c12-4eb3-8b61-e616d47c39e5 req-cc995114-4f40-41a6-9217-308941c8f22b service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:57.680190 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-3b2546b1-4c12-4eb3-8b61-e616d47c39e5 req-cc995114-4f40-41a6-9217-308941c8f22b service nova] Creating event network-vif-plugged:24b6e0c3-3bbc-4a74-8853-d9627d5d6286 for instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b on hv-cinder-84456 Sep 22 15:14:57.685565 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-3b2546b1-4c12-4eb3-8b61-e616d47c39e5 req-cc995114-4f40-41a6-9217-308941c8f22b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033971 Sep 22 15:14:57.686957 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 568/1122] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:14:58.123310 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:58.123934 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:58.130305 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:58.130826 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:58.131251 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:58.131930 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:58.132374 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:58.132788 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:58.263055 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:58.270680 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-9bf08041-3a26-4fc5-abfb-cb9d5a8a9a5f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1265 microversion: 2.1 time: 0.151242 Sep 22 15:14:58.271272 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 555/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:58 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:59.294460 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:59.295182 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:59.301512 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:59.301989 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:59.302427 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:59.303152 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:59.303614 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:59.304043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:59.437358 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:59.445099 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-5378222f-1153-4cfb-83fc-8f56386c0887 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1452 microversion: 2.1 time: 0.154881 Sep 22 15:14:59.445697 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 569/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:59 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:14:59.467378 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:14:59.467985 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:14:59.474647 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:59.475148 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:59.475572 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:59.476280 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:14:59.477248 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:14:59.477664 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:14:59.604709 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:14:59.612618 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-c3d9d80c-d72b-474f-89df-eea6a616a19f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1452 microversion: 2.1 time: 0.149092 Sep 22 15:14:59.613187 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 556/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:14:59 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:15:01.405087 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-34f5a0ba-5a77-41a6-affe-a15bc04da8ac req-df46bcaa-13f9-47d5-ae8f-6c99f5ec02c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b", "tag": "24b6e0c3-3bbc-4a74-8853-d9627d5d6286"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:15:01.414486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-34f5a0ba-5a77-41a6-affe-a15bc04da8ac req-df46bcaa-13f9-47d5-ae8f-6c99f5ec02c3 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:15:01.414995 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-34f5a0ba-5a77-41a6-affe-a15bc04da8ac req-df46bcaa-13f9-47d5-ae8f-6c99f5ec02c3 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:15:01.415426 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-34f5a0ba-5a77-41a6-affe-a15bc04da8ac req-df46bcaa-13f9-47d5-ae8f-6c99f5ec02c3 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:15:01.426553 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-34f5a0ba-5a77-41a6-affe-a15bc04da8ac req-df46bcaa-13f9-47d5-ae8f-6c99f5ec02c3 service nova] Creating event network-changed:24b6e0c3-3bbc-4a74-8853-d9627d5d6286 for instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b on hv-cinder-84456 Sep 22 15:15:01.432154 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-34f5a0ba-5a77-41a6-affe-a15bc04da8ac req-df46bcaa-13f9-47d5-ae8f-6c99f5ec02c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 Sep 22 15:15:01.432763 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 570/1126] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:16:29.571733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_api:SELECT=20 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:16:29.572694 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:29.573199 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:29.573788 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG dbcounter [-] [120694] Writing DB stats nova_cell1:SELECT=40 {{(pid=120694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:16:29.576115 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:16:29.577201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG dbcounter [-] [120695] Writing DB stats nova_cell1:SELECT=46 {{(pid=120695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 15:16:29.578922 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 15:16:29.579110 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Thu Sep 22 15:16:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b (ip 10.222.0.26) !!! Sep 22 15:16:29.593395 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:29.594175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:29.594613 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:29.595362 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:29.595818 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:29.596436 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:29.624850 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:16:29.638831 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-696cd418-ad4a-4fec-a4db-fa76c7c7cb9d req-2f0c34c9-82de-4d50-80f1-799bcfc332e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b", "tag": "24b6e0c3-3bbc-4a74-8853-d9627d5d6286"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:16:29.649058 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-696cd418-ad4a-4fec-a4db-fa76c7c7cb9d req-2f0c34c9-82de-4d50-80f1-799bcfc332e8 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:29.649542 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-696cd418-ad4a-4fec-a4db-fa76c7c7cb9d req-2f0c34c9-82de-4d50-80f1-799bcfc332e8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:29.649975 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-696cd418-ad4a-4fec-a4db-fa76c7c7cb9d req-2f0c34c9-82de-4d50-80f1-799bcfc332e8 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:29.662371 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-696cd418-ad4a-4fec-a4db-fa76c7c7cb9d req-2f0c34c9-82de-4d50-80f1-799bcfc332e8 service nova] Creating event network-changed:24b6e0c3-3bbc-4a74-8853-d9627d5d6286 for instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b on hv-cinder-84456 Sep 22 15:16:29.668690 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-696cd418-ad4a-4fec-a4db-fa76c7c7cb9d req-2f0c34c9-82de-4d50-80f1-799bcfc332e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098885 Sep 22 15:16:29.669574 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 571/1127] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:16:29.710413 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f6b886d4-f3f2-4e89-a496-48cd46f6f852 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "DELETE /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 204 len: 0 microversion: 2.1 time: 0.143620 Sep 22 15:16:29.715136 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 557/1128] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:16:29 2022] DELETE /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:16:29.721237 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:29.722274 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:29.729987 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:29.730472 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:29.730939 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:29.731796 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:29.732251 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:29.732875 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:29.875486 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:16:29.883373 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-d55b2882-7d7e-4606-ab54-5e6260f5c194 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1577 microversion: 2.1 time: 0.166473 Sep 22 15:16:29.884125 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 572/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:29 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:16:30.909137 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:30.909972 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:30.916499 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:30.917037 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:30.917517 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:30.918217 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:30.918667 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:30.919118 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:31.053967 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:16:31.062375 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-34ecdb15-d71b-4526-8bea-8fda591aa3e2 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1577 microversion: 2.1 time: 0.159072 Sep 22 15:16:31.062974 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 558/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:30 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:16:31.848402 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-1b56f388-6161-449c-ac43-5bc111b8bc59 req-b4076432-81a1-4d74-b6ac-15eca22e481e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b", "name": "network-vif-deleted", "tag": "24b6e0c3-3bbc-4a74-8853-d9627d5d6286"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:16:31.858471 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-1b56f388-6161-449c-ac43-5bc111b8bc59 req-b4076432-81a1-4d74-b6ac-15eca22e481e service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:31.859618 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-1b56f388-6161-449c-ac43-5bc111b8bc59 req-b4076432-81a1-4d74-b6ac-15eca22e481e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:31.860054 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-1b56f388-6161-449c-ac43-5bc111b8bc59 req-b4076432-81a1-4d74-b6ac-15eca22e481e service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:31.872252 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-1b56f388-6161-449c-ac43-5bc111b8bc59 req-b4076432-81a1-4d74-b6ac-15eca22e481e service nova] Creating event network-vif-deleted:24b6e0c3-3bbc-4a74-8853-d9627d5d6286 for instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b on hv-cinder-84456 Sep 22 15:16:31.877491 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-1b56f388-6161-449c-ac43-5bc111b8bc59 req-b4076432-81a1-4d74-b6ac-15eca22e481e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100317 Sep 22 15:16:31.878468 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 573/1131] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:16:32.086557 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:32.087500 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:32.095175 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:32.095756 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:32.096286 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:32.097253 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:32.097932 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:32.098363 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:32.138071 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:32.138751 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:32.139409 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:32.139874 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lazy-loading 'fault' on Instance uuid 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:16:32.183496 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:16:32.192108 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-4a7270a3-0d56-4ce0-a463-d7b81b693990 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 200 len: 1230 microversion: 2.1 time: 0.109807 Sep 22 15:16:32.192701 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 559/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:32 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:16:33.218443 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:33.219168 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:33.226004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:33.226485 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:33.226963 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:33.227661 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:33.228118 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:33.228549 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:33.242199 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] HTTP exception thrown: Instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b could not be found. Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Request method failure captured: Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b HTTP/1.1 Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHreeYltevYsHS4eVfp2pDKc9_Dq1kI5pVYkq7IJ5vpgG1l8sHkjBxC9ppmTkn3bkSqyRhbjbriRxnO_JVE5ha1nNaCoCbL6PZuk7scjrOrbAnaQ49WG0nG3mB0n-ADPeD7oyYSqj9aNaGF6bjH9W5kipZkqlbE9mmzzssHpbOjAxAg Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:16:33.243845 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 8d49d3422c7d420db80fe5814a768f53 Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b could not be found. Sep 22 15:16:33.245733 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b'} Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b could not be found. Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:16:33.246751 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b could not be found. Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b could not be found. Sep 22 15:16:33.248461 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:33.250002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Returning 404 to user: Instance 483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:16:33.250002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-c2e5b37e-6063-4ed9-a84c-c84edfb31ccc tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b" status: 404 len: 111 microversion: 2.1 time: 0.031554 Sep 22 15:16:33.250002 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 574/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:33 2022] GET /compute/v2.1/servers/483e7bf8-bbb6-4ad4-9b68-6cc95a0ff38b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:16:36.324256 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:36.325384 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:36.328368 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-e37594f7-41d6-4b50-91a7-53483ec71ee0 req-346e85eb-4b25-424a-99b3-ed60d8a404c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833c7d9c-75a6-4497-89e4-b6806558c3df", "tag": "91c5dd67-fcfe-416a-a91c-9493e83d8cb7"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:16:36.333903 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:36.334399 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:36.334861 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:36.335571 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:36.336050 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:36.336470 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:36.342636 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-e37594f7-41d6-4b50-91a7-53483ec71ee0 req-346e85eb-4b25-424a-99b3-ed60d8a404c6 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:36.343247 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-e37594f7-41d6-4b50-91a7-53483ec71ee0 req-346e85eb-4b25-424a-99b3-ed60d8a404c6 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:36.343749 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-e37594f7-41d6-4b50-91a7-53483ec71ee0 req-346e85eb-4b25-424a-99b3-ed60d8a404c6 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:36.358572 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-e37594f7-41d6-4b50-91a7-53483ec71ee0 req-346e85eb-4b25-424a-99b3-ed60d8a404c6 service nova] Creating event network-changed:91c5dd67-fcfe-416a-a91c-9493e83d8cb7 for instance 833c7d9c-75a6-4497-89e4-b6806558c3df on hv-cinder-84456 Sep 22 15:16:36.364177 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-e37594f7-41d6-4b50-91a7-53483ec71ee0 req-346e85eb-4b25-424a-99b3-ed60d8a404c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039417 Sep 22 15:16:36.364780 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 575/1134] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 15:16:36.373802 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Going to try to terminate instance {{(pid=120695) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 15:16:36.463142 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-5a31677d-e121-418f-a829-d0d7b1365a4f tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "DELETE /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 204 len: 0 microversion: 2.1 time: 0.143257 Sep 22 15:16:36.464132 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 560/1135] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:16:36 2022] DELETE /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 15:16:36.473192 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:36.473892 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:36.482638 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:36.483418 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:36.483775 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:36.484877 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:36.485397 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:36.486033 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:36.629004 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.policy [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120694) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:16:36.637985 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-7d71a2fd-95ee-4c74-80cb-cda20d64e516 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1577 microversion: 2.1 time: 0.168996 Sep 22 15:16:36.638858 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 576/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:36 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:16:37.666168 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:37.666796 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:37.673386 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:37.673870 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:37.674328 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:37.675059 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:37.675538 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:37.675964 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:37.816321 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:16:37.824458 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-f022adef-6e00-4fa5-9742-7689491a1ea0 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1577 microversion: 2.1 time: 0.162750 Sep 22 15:16:37.825007 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 561/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:37 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:16:38.411435 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [req-2161f707-aafb-4be8-9c45-0b67fde62c45 req-d8fb757d-18ea-4d56-8bbb-54cee131e278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833c7d9c-75a6-4497-89e4-b6806558c3df", "name": "network-vif-deleted", "tag": "91c5dd67-fcfe-416a-a91c-9493e83d8cb7"}]} {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 15:16:38.424321 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2161f707-aafb-4be8-9c45-0b67fde62c45 req-d8fb757d-18ea-4d56-8bbb-54cee131e278 service nova] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:38.424818 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2161f707-aafb-4be8-9c45-0b67fde62c45 req-d8fb757d-18ea-4d56-8bbb-54cee131e278 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:38.425248 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [req-2161f707-aafb-4be8-9c45-0b67fde62c45 req-d8fb757d-18ea-4d56-8bbb-54cee131e278 service nova] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:38.437552 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.compute.server_external_events [req-2161f707-aafb-4be8-9c45-0b67fde62c45 req-d8fb757d-18ea-4d56-8bbb-54cee131e278 service nova] Creating event network-vif-deleted:91c5dd67-fcfe-416a-a91c-9493e83d8cb7 for instance 833c7d9c-75a6-4497-89e4-b6806558c3df on hv-cinder-84456 Sep 22 15:16:38.442282 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [req-2161f707-aafb-4be8-9c45-0b67fde62c45 req-d8fb757d-18ea-4d56-8bbb-54cee131e278 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034887 Sep 22 15:16:38.442901 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 577/1138] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Sep 22 15:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 15:16:38.848104 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:38.848776 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:38.856194 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:38.856675 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:38.857115 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:38.857816 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:38.858272 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:38.858700 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:38.889799 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:38.890206 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:38.890645 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:38.891129 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.objects.instance [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lazy-loading 'fault' on Instance uuid 833c7d9c-75a6-4497-89e4-b6806558c3df {{(pid=120695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 15:16:38.931862 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.policy [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d49d3422c7d420db80fe5814a768f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b64f192d3ea436abc310162b1c46efc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120695) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 15:16:38.939737 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-fbc5192c-4805-477a-ba16-011375706d0b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 200 len: 1230 microversion: 2.1 time: 0.095515 Sep 22 15:16:38.940244 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 562/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:38 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 15:16:39.963912 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:39.964691 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 833c7d9c-75a6-4497-89e4-b6806558c3df] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:39.971022 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:39.971508 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:39.972017 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:39.972757 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:39.973216 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:39.973641 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:39.988214 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] HTTP exception thrown: Instance 833c7d9c-75a6-4497-89e4-b6806558c3df could not be found. Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Request method failure captured: Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df HTTP/1.1 Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHreeYltevYsHS4eVfp2pDKc9_Dq1kI5pVYkq7IJ5vpgG1l8sHkjBxC9ppmTkn3bkSqyRhbjbriRxnO_JVE5ha1nNaCoCbL6PZuk7scjrOrbAnaQ49WG0nG3mB0n-ADPeD7oyYSqj9aNaGF6bjH9W5kipZkqlbE9mmzzssHpbOjAxAg Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:16:39.989881 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 8d49d3422c7d420db80fe5814a768f53 Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 833c7d9c-75a6-4497-89e4-b6806558c3df could not be found. Sep 22 15:16:39.991604 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '833c7d9c-75a6-4497-89e4-b6806558c3df'} Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833c7d9c-75a6-4497-89e4-b6806558c3df could not be found. Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:16:39.992579 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833c7d9c-75a6-4497-89e4-b6806558c3df could not be found. Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833c7d9c-75a6-4497-89e4-b6806558c3df could not be found. Sep 22 15:16:39.994194 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:39.996242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Returning 404 to user: Instance 833c7d9c-75a6-4497-89e4-b6806558c3df could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:16:39.996242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-39aef235-8c6e-44f9-8cbe-fcba06d50d9b tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df" status: 404 len: 111 microversion: 2.1 time: 0.032316 Sep 22 15:16:39.996242 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 578/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:39 2022] GET /compute/v2.1/servers/833c7d9c-75a6-4497-89e4-b6806558c3df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:16:40.431576 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:40.432181 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.compute.api [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120695) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:40.438787 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:40.439221 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:40.439657 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:40.440351 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:40.440812 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:40.441269 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG oslo_concurrency.lockutils [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:40.455718 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.wsgi [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] HTTP exception thrown: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Request method failure captured: Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: request: DELETE /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a HTTP/1.1 Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept: application/json Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Accept-Encoding: identity Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Connection: close Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Length: 0 Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Content-Type: application/json Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Host: 10.222.0.26 Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: Openstack-System-Scope: None Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: User-Agent: python-urllib3/1.26.12 Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Auth-Token: gAAAAABjLHreeYltevYsHS4eVfp2pDKc9_Dq1kI5pVYkq7IJ5vpgG1l8sHkjBxC9ppmTkn3bkSqyRhbjbriRxnO_JVE5ha1nNaCoCbL6PZuk7scjrOrbAnaQ49WG0nG3mB0n-ADPeD7oyYSqj9aNaGF6bjH9W5kipZkqlbE9mmzzssHpbOjAxAg Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Id: None Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Domain-Name: None Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Identity-Status: Confirmed Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Is-Admin-Project: True Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Id: default Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Domain-Name: Default Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Project-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Role: member,reader Sep 22 15:16:40.457394 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Roles: member,reader Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-Tenant-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Id: default Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Domain-Name: Default Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Id: 8d49d3422c7d420db80fe5814a768f53 Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: X-User-Name: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: method: > Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: exception: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.459201 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: action_args: {'id': '5c6430ac-d145-4dc0-b048-ded1ea71ee5a'} Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:16:40.460207 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.461786 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.463431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Returning 404 to user: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. {{(pid=120695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:16:40.463431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-30cde2e9-8cb6-4522-a5a1-b3b3b6dd4317 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 404 len: 111 microversion: 2.1 time: 0.031155 Sep 22 15:16:40.463431 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 563/1141] 10.222.0.26 () {58 vars in 1239 bytes} [Thu Sep 22 15:16:40 2022] DELETE /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 15:16:40.468234 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '>' {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:40.468861 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.compute.api [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] [instance: 5c6430ac-d145-4dc0-b048-ded1ea71ee5a] Fetching instance by UUID {{(pid=120694) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 15:16:40.475307 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:40.476043 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:40.476482 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:40.477176 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Acquiring lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 15:16:40.477635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 15:16:40.478062 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG oslo_concurrency.lockutils [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Lock "2ef4f12c-857d-4a11-a78f-7971a18e68a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 15:16:40.492065 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.wsgi [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] HTTP exception thrown: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Request method failure captured: Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: request: GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a HTTP/1.1 Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept: application/json Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Accept-Encoding: identity Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Connection: close Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Length: 0 Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Content-Type: application/json Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Host: 10.222.0.26 Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: Openstack-System-Scope: None Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: User-Agent: python-urllib3/1.26.12 Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Auth-Token: gAAAAABjLHreeYltevYsHS4eVfp2pDKc9_Dq1kI5pVYkq7IJ5vpgG1l8sHkjBxC9ppmTkn3bkSqyRhbjbriRxnO_JVE5ha1nNaCoCbL6PZuk7scjrOrbAnaQ49WG0nG3mB0n-ADPeD7oyYSqj9aNaGF6bjH9W5kipZkqlbE9mmzzssHpbOjAxAg Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Id: None Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Domain-Name: None Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Identity-Status: Confirmed Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Is-Admin-Project: True Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Id: default Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Domain-Name: Default Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Project-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Role: member,reader Sep 22 15:16:40.493585 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Roles: member,reader Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1b64f192d3ea436abc310162b1c46efc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Id: 1b64f192d3ea436abc310162b1c46efc Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-Tenant-Name: tempest-TestVolumeBootPattern-742437028 Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Id: default Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Domain-Name: Default Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Id: 8d49d3422c7d420db80fe5814a768f53 Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: X-User-Name: tempest-TestVolumeBootPattern-742437028-project Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: method: > Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: exception: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.495635 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: action_args: {'id': '5c6430ac-d145-4dc0-b048-ded1ea71ee5a'} Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: {{(pid=120694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 15:16:40.496629 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. Sep 22 15:16:40.498250 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: ERROR nova.api.openstack.wsgi Sep 22 15:16:40.499843 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: DEBUG nova.api.openstack.wsgi [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Returning 404 to user: Instance 5c6430ac-d145-4dc0-b048-ded1ea71ee5a could not be found. {{(pid=120694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 15:16:40.499843 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: INFO nova.api.openstack.requestlog [None req-918e69cb-6496-440f-9609-e4cfc90a46e9 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a" status: 404 len: 111 microversion: 2.1 time: 0.031194 Sep 22 15:16:40.499843 dv-cinder-844563-6-iscsi devstack@n-api.service[120694]: [pid: 120694|app: 0|req: 579/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Thu Sep 22 15:16:40 2022] GET /compute/v2.1/servers/5c6430ac-d145-4dc0-b048-ded1ea71ee5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 15:16:41.797058 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: DEBUG nova.api.openstack.wsgi [None req-696fd455-af51-4edb-9e1e-c2120fbe3c41 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] Calling method '.version_select at 0x7f77e6fb61f0>' {{(pid=120695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 15:16:41.822233 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: INFO nova.api.openstack.requestlog [None req-696fd455-af51-4edb-9e1e-c2120fbe3c41 tempest-TestVolumeBootPattern-742437028 tempest-TestVolumeBootPattern-742437028-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1004651777" status: 202 len: 0 microversion: 2.1 time: 0.029992 Sep 22 15:16:41.823106 dv-cinder-844563-6-iscsi devstack@n-api.service[120695]: [pid: 120695|app: 0|req: 564/1143] 10.222.0.26 () {58 vars in 1263 bytes} [Thu Sep 22 15:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1004651777 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)